Visualizing Spark application using web UI

When a Spark job is submitted for execution, a web application UI is launched that displays useful information about the application. An event timeline displays the relative ordering and interleaving of application events. The timeline view is available on three levels: across all jobs, within one job, and within one stage. The timeline also shows executor allocation and deallocation.

Figure 15: Spark jobs executed as DAG on Spark web UI

Get Scala and Spark for Big Data Analytics now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.