3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 498 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 443
Associated Job Ids:
498
DAG Visualization
digraph G { subgraph clusterstage_498 { label="Stage 498"; 5233 [labelType="html" label="SQLExecutionRDD [5233]<br>run at <unknown>:0"]; 5241 [labelType="html" label="SQLExecutionRDD [5241]<br>toJavaRDD at <unknown>:0"]; 5243 [labelType="html" label="PythonRDD [5243]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11708 { label="MicroBatchScan"; 5229 [labelType="html" label="DataSourceRDD [5229]<br>run at <unknown>:0"]; 5230 [labelType="html" label="MapPartitionsRDD [5230]<br>run at <unknown>:0"]; } subgraph cluster11707 { label="Project"; 5231 [labelType="html" label="MapPartitionsRDD [5231]<br>run at <unknown>:0"]; } subgraph cluster11703 { label="WholeStageCodegen (1)"; 5232 [labelType="html" label="MapPartitionsRDD [5232]<br>run at <unknown>:0"]; } subgraph cluster11717 { label="WholeStageCodegen (1)"; 5234 [labelType="html" label="MapPartitionsRDD [5234]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11716 { label="Filter"; 5235 [labelType="html" label="MapPartitionsRDD [5235]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11715 { label="Project"; 5236 [labelType="html" label="MapPartitionsRDD [5236]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11712 { label="WholeStageCodegen (2)"; 5237 [labelType="html" label="MapPartitionsRDD [5237]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11711 { label="Project"; 5238 [labelType="html" label="MapPartitionsRDD [5238]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11710 { label="DeserializeToObject"; 5239 [labelType="html" label="MapPartitionsRDD [5239]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11709 { label="MapPartitions"; 5240 [labelType="html" label="MapPartitionsRDD [5240]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11719 { label="mapPartitions"; 5242 [labelType="html" label="MapPartitionsRDD [5242]<br>toJavaRDD at <unknown>:0"]; } } 5229->5230; 5230->5231; 5231->5232; 5232->5233; 5233->5234; 5234->5235; 5235->5236; 5236->5237; 5237->5238; 5238->5239; 5239->5240; 5240->5241; 5241->5242; 5242->5243; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time