3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1728 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 455
Associated Job Ids:
1728
DAG Visualization
digraph G { subgraph clusterstage_1728 { label="Stage 1728"; 18148 [labelType="html" label="SQLExecutionRDD [18148]<br>run at <unknown>:0"]; 18156 [labelType="html" label="SQLExecutionRDD [18156]<br>toJavaRDD at <unknown>:0"]; 18158 [labelType="html" label="PythonRDD [18158]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40613 { label="MicroBatchScan"; 18144 [labelType="html" label="DataSourceRDD [18144]<br>run at <unknown>:0"]; 18145 [labelType="html" label="MapPartitionsRDD [18145]<br>run at <unknown>:0"]; } subgraph cluster40612 { label="Project"; 18146 [labelType="html" label="MapPartitionsRDD [18146]<br>run at <unknown>:0"]; } subgraph cluster40608 { label="WholeStageCodegen (1)"; 18147 [labelType="html" label="MapPartitionsRDD [18147]<br>run at <unknown>:0"]; } subgraph cluster40622 { label="WholeStageCodegen (1)"; 18149 [labelType="html" label="MapPartitionsRDD [18149]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40621 { label="Filter"; 18150 [labelType="html" label="MapPartitionsRDD [18150]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40620 { label="Project"; 18151 [labelType="html" label="MapPartitionsRDD [18151]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40617 { label="WholeStageCodegen (2)"; 18152 [labelType="html" label="MapPartitionsRDD [18152]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40616 { label="Project"; 18153 [labelType="html" label="MapPartitionsRDD [18153]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40615 { label="DeserializeToObject"; 18154 [labelType="html" label="MapPartitionsRDD [18154]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40614 { label="MapPartitions"; 18155 [labelType="html" label="MapPartitionsRDD [18155]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40624 { label="mapPartitions"; 18157 [labelType="html" label="MapPartitionsRDD [18157]<br>toJavaRDD at <unknown>:0"]; } } 18144->18145; 18145->18146; 18146->18147; 18147->18148; 18148->18149; 18149->18150; 18150->18151; 18151->18152; 18152->18153; 18153->18154; 18154->18155; 18155->18156; 18156->18157; 18157->18158; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time