3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1639 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 413
Associated Job Ids:
1640
DAG Visualization
digraph G { subgraph clusterstage_1639 { label="Stage 1639"; 17225 [labelType="html" label="SQLExecutionRDD [17225]<br>run at <unknown>:0"]; 17233 [labelType="html" label="SQLExecutionRDD [17233]<br>toJavaRDD at <unknown>:0"]; 17235 [labelType="html" label="PythonRDD [17235]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster38541 { label="MicroBatchScan"; 17221 [labelType="html" label="DataSourceRDD [17221]<br>run at <unknown>:0"]; 17222 [labelType="html" label="MapPartitionsRDD [17222]<br>run at <unknown>:0"]; } subgraph cluster38540 { label="Project"; 17223 [labelType="html" label="MapPartitionsRDD [17223]<br>run at <unknown>:0"]; } subgraph cluster38536 { label="WholeStageCodegen (1)"; 17224 [labelType="html" label="MapPartitionsRDD [17224]<br>run at <unknown>:0"]; } subgraph cluster38550 { label="WholeStageCodegen (1)"; 17226 [labelType="html" label="MapPartitionsRDD [17226]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38549 { label="Filter"; 17227 [labelType="html" label="MapPartitionsRDD [17227]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38548 { label="Project"; 17228 [labelType="html" label="MapPartitionsRDD [17228]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38545 { label="WholeStageCodegen (2)"; 17229 [labelType="html" label="MapPartitionsRDD [17229]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38544 { label="Project"; 17230 [labelType="html" label="MapPartitionsRDD [17230]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38543 { label="DeserializeToObject"; 17231 [labelType="html" label="MapPartitionsRDD [17231]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38542 { label="MapPartitions"; 17232 [labelType="html" label="MapPartitionsRDD [17232]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38552 { label="mapPartitions"; 17234 [labelType="html" label="MapPartitionsRDD [17234]<br>toJavaRDD at <unknown>:0"]; } } 17221->17222; 17222->17223; 17223->17224; 17224->17225; 17225->17226; 17226->17227; 17227->17228; 17228->17229; 17229->17230; 17230->17231; 17231->17232; 17232->17233; 17233->17234; 17234->17235; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time