3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 114 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 348
Associated Job Ids:
114
DAG Visualization
digraph G { subgraph clusterstage_114 { label="Stage 114"; 1201 [labelType="html" label="SQLExecutionRDD [1201]<br>run at <unknown>:0"]; 1209 [labelType="html" label="SQLExecutionRDD [1209]<br>toJavaRDD at <unknown>:0"]; 1211 [labelType="html" label="PythonRDD [1211]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster2684 { label="MicroBatchScan"; 1197 [labelType="html" label="DataSourceRDD [1197]<br>run at <unknown>:0"]; 1198 [labelType="html" label="MapPartitionsRDD [1198]<br>run at <unknown>:0"]; } subgraph cluster2683 { label="Project"; 1199 [labelType="html" label="MapPartitionsRDD [1199]<br>run at <unknown>:0"]; } subgraph cluster2679 { label="WholeStageCodegen (1)"; 1200 [labelType="html" label="MapPartitionsRDD [1200]<br>run at <unknown>:0"]; } subgraph cluster2693 { label="WholeStageCodegen (1)"; 1202 [labelType="html" label="MapPartitionsRDD [1202]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2692 { label="Filter"; 1203 [labelType="html" label="MapPartitionsRDD [1203]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2691 { label="Project"; 1204 [labelType="html" label="MapPartitionsRDD [1204]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2688 { label="WholeStageCodegen (2)"; 1205 [labelType="html" label="MapPartitionsRDD [1205]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2687 { label="Project"; 1206 [labelType="html" label="MapPartitionsRDD [1206]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2686 { label="DeserializeToObject"; 1207 [labelType="html" label="MapPartitionsRDD [1207]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2685 { label="MapPartitions"; 1208 [labelType="html" label="MapPartitionsRDD [1208]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2695 { label="mapPartitions"; 1210 [labelType="html" label="MapPartitionsRDD [1210]<br>toJavaRDD at <unknown>:0"]; } } 1197->1198; 1198->1199; 1199->1200; 1200->1201; 1201->1202; 1202->1203; 1203->1204; 1204->1205; 1205->1206; 1206->1207; 1207->1208; 1208->1209; 1209->1210; 1210->1211; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time