3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 602 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 561
Associated Job Ids:
602
DAG Visualization
digraph G { subgraph clusterstage_602 { label="Stage 602"; 6325 [labelType="html" label="SQLExecutionRDD [6325]<br>run at <unknown>:0"]; 6333 [labelType="html" label="SQLExecutionRDD [6333]<br>toJavaRDD at <unknown>:0"]; 6335 [labelType="html" label="PythonRDD [6335]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14152 { label="MicroBatchScan"; 6321 [labelType="html" label="DataSourceRDD [6321]<br>run at <unknown>:0"]; 6322 [labelType="html" label="MapPartitionsRDD [6322]<br>run at <unknown>:0"]; } subgraph cluster14151 { label="Project"; 6323 [labelType="html" label="MapPartitionsRDD [6323]<br>run at <unknown>:0"]; } subgraph cluster14147 { label="WholeStageCodegen (1)"; 6324 [labelType="html" label="MapPartitionsRDD [6324]<br>run at <unknown>:0"]; } subgraph cluster14161 { label="WholeStageCodegen (1)"; 6326 [labelType="html" label="MapPartitionsRDD [6326]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14160 { label="Filter"; 6327 [labelType="html" label="MapPartitionsRDD [6327]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14159 { label="Project"; 6328 [labelType="html" label="MapPartitionsRDD [6328]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14156 { label="WholeStageCodegen (2)"; 6329 [labelType="html" label="MapPartitionsRDD [6329]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14155 { label="Project"; 6330 [labelType="html" label="MapPartitionsRDD [6330]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14154 { label="DeserializeToObject"; 6331 [labelType="html" label="MapPartitionsRDD [6331]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14153 { label="MapPartitions"; 6332 [labelType="html" label="MapPartitionsRDD [6332]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14163 { label="mapPartitions"; 6334 [labelType="html" label="MapPartitionsRDD [6334]<br>toJavaRDD at <unknown>:0"]; } } 6321->6322; 6322->6323; 6323->6324; 6324->6325; 6325->6326; 6326->6327; 6327->6328; 6328->6329; 6329->6330; 6330->6331; 6331->6332; 6332->6333; 6333->6334; 6334->6335; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time