3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 596 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 444
Associated Job Ids:
596
DAG Visualization
digraph G { subgraph clusterstage_596 { label="Stage 596"; 6262 [labelType="html" label="SQLExecutionRDD [6262]<br>run at <unknown>:0"]; 6270 [labelType="html" label="SQLExecutionRDD [6270]<br>toJavaRDD at <unknown>:0"]; 6272 [labelType="html" label="PythonRDD [6272]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14011 { label="MicroBatchScan"; 6258 [labelType="html" label="DataSourceRDD [6258]<br>run at <unknown>:0"]; 6259 [labelType="html" label="MapPartitionsRDD [6259]<br>run at <unknown>:0"]; } subgraph cluster14010 { label="Project"; 6260 [labelType="html" label="MapPartitionsRDD [6260]<br>run at <unknown>:0"]; } subgraph cluster14006 { label="WholeStageCodegen (1)"; 6261 [labelType="html" label="MapPartitionsRDD [6261]<br>run at <unknown>:0"]; } subgraph cluster14020 { label="WholeStageCodegen (1)"; 6263 [labelType="html" label="MapPartitionsRDD [6263]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14019 { label="Filter"; 6264 [labelType="html" label="MapPartitionsRDD [6264]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14018 { label="Project"; 6265 [labelType="html" label="MapPartitionsRDD [6265]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14015 { label="WholeStageCodegen (2)"; 6266 [labelType="html" label="MapPartitionsRDD [6266]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14014 { label="Project"; 6267 [labelType="html" label="MapPartitionsRDD [6267]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14013 { label="DeserializeToObject"; 6268 [labelType="html" label="MapPartitionsRDD [6268]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14012 { label="MapPartitions"; 6269 [labelType="html" label="MapPartitionsRDD [6269]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14022 { label="mapPartitions"; 6271 [labelType="html" label="MapPartitionsRDD [6271]<br>toJavaRDD at <unknown>:0"]; } } 6258->6259; 6259->6260; 6260->6261; 6261->6262; 6262->6263; 6263->6264; 6264->6265; 6265->6266; 6266->6267; 6267->6268; 6268->6269; 6269->6270; 6270->6271; 6271->6272; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time