Thread dumps are also useful for debugging issues where the driver appears to be hanging (for example, no Spark progress bars are showing) or making no progress on queries (for example, Spark progress bars are stuck at 100%). To view the driver’s thread dump in the Spark UI: ...
Attaching screenshot below and also typing in case someone comes from the web to this thread in future. Problem : - It says "failed to start cluster" initially, then i click OK and refresh then i get this below:- Waiting for cluster to start: Unexpected failure during launch. databricks_...
I stopped the training now but if it is okey with you we can schedule today a skype meeting and before that I will run my notebook again so we can check the worker statues and depending on that, we will adjust :)Contributor
Thread dumps are also useful for debugging issues where the driver appears to be hanging (for example, no Spark progress bars are showing) or making no progress on queries (for example, Spark progress bars are stuck at 100%). To view the driver’s thread dump in the Spark UI: ...