3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1833 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 475
Associated Job Ids:
1833
DAG Visualization
digraph G { subgraph clusterstage_1833 { label="Stage 1833"; 19246 [labelType="html" label="SQLExecutionRDD [19246]<br>run at <unknown>:0"]; 19254 [labelType="html" label="SQLExecutionRDD [19254]<br>toJavaRDD at <unknown>:0"]; 19256 [labelType="html" label="PythonRDD [19256]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43065 { label="MicroBatchScan"; 19237 [labelType="html" label="DataSourceRDD [19237]<br>run at <unknown>:0"]; 19239 [labelType="html" label="MapPartitionsRDD [19239]<br>run at <unknown>:0"]; } subgraph cluster43064 { label="Project"; 19241 [labelType="html" label="MapPartitionsRDD [19241]<br>run at <unknown>:0"]; } subgraph cluster43058 { label="WholeStageCodegen (1)"; 19243 [labelType="html" label="MapPartitionsRDD [19243]<br>run at <unknown>:0"]; } subgraph cluster43074 { label="WholeStageCodegen (1)"; 19247 [labelType="html" label="MapPartitionsRDD [19247]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43073 { label="Filter"; 19248 [labelType="html" label="MapPartitionsRDD [19248]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43072 { label="Project"; 19249 [labelType="html" label="MapPartitionsRDD [19249]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43069 { label="WholeStageCodegen (2)"; 19250 [labelType="html" label="MapPartitionsRDD [19250]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43068 { label="Project"; 19251 [labelType="html" label="MapPartitionsRDD [19251]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43067 { label="DeserializeToObject"; 19252 [labelType="html" label="MapPartitionsRDD [19252]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43066 { label="MapPartitions"; 19253 [labelType="html" label="MapPartitionsRDD [19253]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43076 { label="mapPartitions"; 19255 [labelType="html" label="MapPartitionsRDD [19255]<br>toJavaRDD at <unknown>:0"]; } } 19237->19239; 19239->19241; 19241->19243; 19243->19246; 19246->19247; 19247->19248; 19248->19249; 19249->19250; 19250->19251; 19251->19252; 19252->19253; 19253->19254; 19254->19255; 19255->19256; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time