3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 311 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 392
Associated Job Ids:
311
DAG Visualization
digraph G { subgraph clusterstage_311 { label="Stage 311"; 3265 [labelType="html" label="SQLExecutionRDD [3265]<br>run at <unknown>:0"]; 3273 [labelType="html" label="SQLExecutionRDD [3273]<br>toJavaRDD at <unknown>:0"]; 3275 [labelType="html" label="PythonRDD [3275]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7298 { label="MicroBatchScan"; 3261 [labelType="html" label="DataSourceRDD [3261]<br>run at <unknown>:0"]; 3262 [labelType="html" label="MapPartitionsRDD [3262]<br>run at <unknown>:0"]; } subgraph cluster7297 { label="Project"; 3263 [labelType="html" label="MapPartitionsRDD [3263]<br>run at <unknown>:0"]; } subgraph cluster7293 { label="WholeStageCodegen (1)"; 3264 [labelType="html" label="MapPartitionsRDD [3264]<br>run at <unknown>:0"]; } subgraph cluster7307 { label="WholeStageCodegen (1)"; 3266 [labelType="html" label="MapPartitionsRDD [3266]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7306 { label="Filter"; 3267 [labelType="html" label="MapPartitionsRDD [3267]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7305 { label="Project"; 3268 [labelType="html" label="MapPartitionsRDD [3268]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7302 { label="WholeStageCodegen (2)"; 3269 [labelType="html" label="MapPartitionsRDD [3269]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7301 { label="Project"; 3270 [labelType="html" label="MapPartitionsRDD [3270]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7300 { label="DeserializeToObject"; 3271 [labelType="html" label="MapPartitionsRDD [3271]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7299 { label="MapPartitions"; 3272 [labelType="html" label="MapPartitionsRDD [3272]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7309 { label="mapPartitions"; 3274 [labelType="html" label="MapPartitionsRDD [3274]<br>toJavaRDD at <unknown>:0"]; } } 3261->3262; 3262->3263; 3263->3264; 3264->3265; 3265->3266; 3266->3267; 3267->3268; 3268->3269; 3269->3270; 3270->3271; 3271->3272; 3272->3273; 3273->3274; 3274->3275; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time