3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 96 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 522
Associated Job Ids:
96
DAG Visualization
digraph G { subgraph clusterstage_96 { label="Stage 96"; 1012 [labelType="html" label="SQLExecutionRDD [1012]<br>run at <unknown>:0"]; 1020 [labelType="html" label="SQLExecutionRDD [1020]<br>toJavaRDD at <unknown>:0"]; 1022 [labelType="html" label="PythonRDD [1022]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster2261 { label="MicroBatchScan"; 1008 [labelType="html" label="DataSourceRDD [1008]<br>run at <unknown>:0"]; 1009 [labelType="html" label="MapPartitionsRDD [1009]<br>run at <unknown>:0"]; } subgraph cluster2260 { label="Project"; 1010 [labelType="html" label="MapPartitionsRDD [1010]<br>run at <unknown>:0"]; } subgraph cluster2256 { label="WholeStageCodegen (1)"; 1011 [labelType="html" label="MapPartitionsRDD [1011]<br>run at <unknown>:0"]; } subgraph cluster2270 { label="WholeStageCodegen (1)"; 1013 [labelType="html" label="MapPartitionsRDD [1013]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2269 { label="Filter"; 1014 [labelType="html" label="MapPartitionsRDD [1014]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2268 { label="Project"; 1015 [labelType="html" label="MapPartitionsRDD [1015]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2265 { label="WholeStageCodegen (2)"; 1016 [labelType="html" label="MapPartitionsRDD [1016]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2264 { label="Project"; 1017 [labelType="html" label="MapPartitionsRDD [1017]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2263 { label="DeserializeToObject"; 1018 [labelType="html" label="MapPartitionsRDD [1018]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2262 { label="MapPartitions"; 1019 [labelType="html" label="MapPartitionsRDD [1019]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster2272 { label="mapPartitions"; 1021 [labelType="html" label="MapPartitionsRDD [1021]<br>toJavaRDD at <unknown>:0"]; } } 1008->1009; 1009->1010; 1010->1011; 1011->1012; 1012->1013; 1013->1014; 1014->1015; 1015->1016; 1016->1017; 1017->1018; 1018->1019; 1019->1020; 1020->1021; 1021->1022; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time