3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1736 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 483
Associated Job Ids:
1736
DAG Visualization
digraph G { subgraph clusterstage_1736 { label="Stage 1736"; 18232 [labelType="html" label="SQLExecutionRDD [18232]<br>run at <unknown>:0"]; 18240 [labelType="html" label="SQLExecutionRDD [18240]<br>toJavaRDD at <unknown>:0"]; 18242 [labelType="html" label="PythonRDD [18242]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40801 { label="MicroBatchScan"; 18228 [labelType="html" label="DataSourceRDD [18228]<br>run at <unknown>:0"]; 18229 [labelType="html" label="MapPartitionsRDD [18229]<br>run at <unknown>:0"]; } subgraph cluster40800 { label="Project"; 18230 [labelType="html" label="MapPartitionsRDD [18230]<br>run at <unknown>:0"]; } subgraph cluster40796 { label="WholeStageCodegen (1)"; 18231 [labelType="html" label="MapPartitionsRDD [18231]<br>run at <unknown>:0"]; } subgraph cluster40810 { label="WholeStageCodegen (1)"; 18233 [labelType="html" label="MapPartitionsRDD [18233]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40809 { label="Filter"; 18234 [labelType="html" label="MapPartitionsRDD [18234]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40808 { label="Project"; 18235 [labelType="html" label="MapPartitionsRDD [18235]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40805 { label="WholeStageCodegen (2)"; 18236 [labelType="html" label="MapPartitionsRDD [18236]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40804 { label="Project"; 18237 [labelType="html" label="MapPartitionsRDD [18237]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40803 { label="DeserializeToObject"; 18238 [labelType="html" label="MapPartitionsRDD [18238]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40802 { label="MapPartitions"; 18239 [labelType="html" label="MapPartitionsRDD [18239]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40812 { label="mapPartitions"; 18241 [labelType="html" label="MapPartitionsRDD [18241]<br>toJavaRDD at <unknown>:0"]; } } 18228->18229; 18229->18230; 18230->18231; 18231->18232; 18232->18233; 18233->18234; 18234->18235; 18235->18236; 18236->18237; 18237->18238; 18238->18239; 18239->18240; 18240->18241; 18241->18242; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time