3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 113 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 568
Associated Job Ids:
113
DAG Visualization
digraph G { subgraph clusterstage_113 { label="Stage 113"; 1181 [labelType="html" label="SQLExecutionRDD [1181]<br>run at <unknown>:0"]; 1194 [labelType="html" label="SQLExecutionRDD [1194]<br>toJavaRDD at <unknown>:0"]; 1196 [labelType="html" label="PythonRDD [1196]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster2644 { label="MicroBatchScan"; 1176 [labelType="html" label="DataSourceRDD [1176]<br>run at <unknown>:0"]; 1178 [labelType="html" label="MapPartitionsRDD [1178]<br>run at <unknown>:0"]; } subgraph cluster2643 { label="Project"; 1179 [labelType="html" label="MapPartitionsRDD [1179]<br>run at <unknown>:0"]; } subgraph cluster2638 { label="WholeStageCodegen (1)"; 1180 [labelType="html" label="MapPartitionsRDD [1180]<br>run at <unknown>:0"]; } subgraph cluster2654 { label="WholeStageCodegen (1)"; 1187 [labelType="html" label="MapPartitionsRDD [1187]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2653 { label="Filter"; 1188 [labelType="html" label="MapPartitionsRDD [1188]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2652 { label="Project"; 1189 [labelType="html" label="MapPartitionsRDD [1189]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2649 { label="WholeStageCodegen (2)"; 1190 [labelType="html" label="MapPartitionsRDD [1190]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2648 { label="Project"; 1191 [labelType="html" label="MapPartitionsRDD [1191]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2647 { label="DeserializeToObject"; 1192 [labelType="html" label="MapPartitionsRDD [1192]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2646 { label="MapPartitions"; 1193 [labelType="html" label="MapPartitionsRDD [1193]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2656 { label="mapPartitions"; 1195 [labelType="html" label="MapPartitionsRDD [1195]<br>toJavaRDD at <unknown>:0"]; } } 1176->1178; 1178->1179; 1179->1180; 1180->1181; 1181->1187; 1187->1188; 1188->1189; 1189->1190; 1190->1191; 1191->1192; 1192->1193; 1193->1194; 1194->1195; 1195->1196; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time