3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 503 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 512
Associated Job Ids:
503
DAG Visualization
digraph G { subgraph clusterstage_503 { label="Stage 503"; 5275 [labelType="html" label="SQLExecutionRDD [5275]<br>run at <unknown>:0"]; 5289 [labelType="html" label="SQLExecutionRDD [5289]<br>toJavaRDD at <unknown>:0"]; 5291 [labelType="html" label="PythonRDD [5291]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11802 { label="MicroBatchScan"; 5271 [labelType="html" label="DataSourceRDD [5271]<br>run at <unknown>:0"]; 5272 [labelType="html" label="MapPartitionsRDD [5272]<br>run at <unknown>:0"]; } subgraph cluster11801 { label="Project"; 5273 [labelType="html" label="MapPartitionsRDD [5273]<br>run at <unknown>:0"]; } subgraph cluster11797 { label="WholeStageCodegen (1)"; 5274 [labelType="html" label="MapPartitionsRDD [5274]<br>run at <unknown>:0"]; } subgraph cluster11819 { label="WholeStageCodegen (1)"; 5282 [labelType="html" label="MapPartitionsRDD [5282]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11818 { label="Filter"; 5283 [labelType="html" label="MapPartitionsRDD [5283]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11817 { label="Project"; 5284 [labelType="html" label="MapPartitionsRDD [5284]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11814 { label="WholeStageCodegen (2)"; 5285 [labelType="html" label="MapPartitionsRDD [5285]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11813 { label="Project"; 5286 [labelType="html" label="MapPartitionsRDD [5286]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11812 { label="DeserializeToObject"; 5287 [labelType="html" label="MapPartitionsRDD [5287]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11811 { label="MapPartitions"; 5288 [labelType="html" label="MapPartitionsRDD [5288]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11821 { label="mapPartitions"; 5290 [labelType="html" label="MapPartitionsRDD [5290]<br>toJavaRDD at <unknown>:0"]; } } 5271->5272; 5272->5273; 5273->5274; 5274->5275; 5275->5282; 5282->5283; 5283->5284; 5284->5285; 5285->5286; 5286->5287; 5287->5288; 5288->5289; 5289->5290; 5290->5291; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time