3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2023 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 403
Associated Job Ids:
2024
DAG Visualization
digraph G { subgraph clusterstage_2023 { label="Stage 2023"; 21257 [labelType="html" label="SQLExecutionRDD [21257]<br>run at <unknown>:0"]; 21265 [labelType="html" label="SQLExecutionRDD [21265]<br>toJavaRDD at <unknown>:0"]; 21267 [labelType="html" label="PythonRDD [21267]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47565 { label="MicroBatchScan"; 21253 [labelType="html" label="DataSourceRDD [21253]<br>run at <unknown>:0"]; 21254 [labelType="html" label="MapPartitionsRDD [21254]<br>run at <unknown>:0"]; } subgraph cluster47564 { label="Project"; 21255 [labelType="html" label="MapPartitionsRDD [21255]<br>run at <unknown>:0"]; } subgraph cluster47560 { label="WholeStageCodegen (1)"; 21256 [labelType="html" label="MapPartitionsRDD [21256]<br>run at <unknown>:0"]; } subgraph cluster47574 { label="WholeStageCodegen (1)"; 21258 [labelType="html" label="MapPartitionsRDD [21258]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47573 { label="Filter"; 21259 [labelType="html" label="MapPartitionsRDD [21259]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47572 { label="Project"; 21260 [labelType="html" label="MapPartitionsRDD [21260]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47569 { label="WholeStageCodegen (2)"; 21261 [labelType="html" label="MapPartitionsRDD [21261]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47568 { label="Project"; 21262 [labelType="html" label="MapPartitionsRDD [21262]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47567 { label="DeserializeToObject"; 21263 [labelType="html" label="MapPartitionsRDD [21263]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47566 { label="MapPartitions"; 21264 [labelType="html" label="MapPartitionsRDD [21264]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47576 { label="mapPartitions"; 21266 [labelType="html" label="MapPartitionsRDD [21266]<br>toJavaRDD at <unknown>:0"]; } } 21253->21254; 21254->21255; 21255->21256; 21256->21257; 21257->21258; 21258->21259; 21259->21260; 21260->21261; 21261->21262; 21262->21263; 21263->21264; 21264->21265; 21265->21266; 21266->21267; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time