3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1324 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 409
Associated Job Ids:
1324
DAG Visualization
digraph G { subgraph clusterstage_1324 { label="Stage 1324"; 13906 [labelType="html" label="SQLExecutionRDD [13906]<br>run at <unknown>:0"]; 13914 [labelType="html" label="SQLExecutionRDD [13914]<br>toJavaRDD at <unknown>:0"]; 13916 [labelType="html" label="PythonRDD [13916]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster31119 { label="MicroBatchScan"; 13902 [labelType="html" label="DataSourceRDD [13902]<br>run at <unknown>:0"]; 13903 [labelType="html" label="MapPartitionsRDD [13903]<br>run at <unknown>:0"]; } subgraph cluster31118 { label="Project"; 13904 [labelType="html" label="MapPartitionsRDD [13904]<br>run at <unknown>:0"]; } subgraph cluster31114 { label="WholeStageCodegen (1)"; 13905 [labelType="html" label="MapPartitionsRDD [13905]<br>run at <unknown>:0"]; } subgraph cluster31128 { label="WholeStageCodegen (1)"; 13907 [labelType="html" label="MapPartitionsRDD [13907]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31127 { label="Filter"; 13908 [labelType="html" label="MapPartitionsRDD [13908]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31126 { label="Project"; 13909 [labelType="html" label="MapPartitionsRDD [13909]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31123 { label="WholeStageCodegen (2)"; 13910 [labelType="html" label="MapPartitionsRDD [13910]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31122 { label="Project"; 13911 [labelType="html" label="MapPartitionsRDD [13911]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31121 { label="DeserializeToObject"; 13912 [labelType="html" label="MapPartitionsRDD [13912]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31120 { label="MapPartitions"; 13913 [labelType="html" label="MapPartitionsRDD [13913]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31130 { label="mapPartitions"; 13915 [labelType="html" label="MapPartitionsRDD [13915]<br>toJavaRDD at <unknown>:0"]; } } 13902->13903; 13903->13904; 13904->13905; 13905->13906; 13906->13907; 13907->13908; 13908->13909; 13909->13910; 13910->13911; 13911->13912; 13912->13913; 13913->13914; 13914->13915; 13915->13916; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time