3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1937 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 556
Associated Job Ids:
1938
DAG Visualization
digraph G { subgraph clusterstage_1937 { label="Stage 1937"; 20354 [labelType="html" label="SQLExecutionRDD [20354]<br>run at <unknown>:0"]; 20362 [labelType="html" label="SQLExecutionRDD [20362]<br>toJavaRDD at <unknown>:0"]; 20364 [labelType="html" label="PythonRDD [20364]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster45544 { label="MicroBatchScan"; 20350 [labelType="html" label="DataSourceRDD [20350]<br>run at <unknown>:0"]; 20351 [labelType="html" label="MapPartitionsRDD [20351]<br>run at <unknown>:0"]; } subgraph cluster45543 { label="Project"; 20352 [labelType="html" label="MapPartitionsRDD [20352]<br>run at <unknown>:0"]; } subgraph cluster45539 { label="WholeStageCodegen (1)"; 20353 [labelType="html" label="MapPartitionsRDD [20353]<br>run at <unknown>:0"]; } subgraph cluster45553 { label="WholeStageCodegen (1)"; 20355 [labelType="html" label="MapPartitionsRDD [20355]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45552 { label="Filter"; 20356 [labelType="html" label="MapPartitionsRDD [20356]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45551 { label="Project"; 20357 [labelType="html" label="MapPartitionsRDD [20357]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45548 { label="WholeStageCodegen (2)"; 20358 [labelType="html" label="MapPartitionsRDD [20358]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45547 { label="Project"; 20359 [labelType="html" label="MapPartitionsRDD [20359]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45546 { label="DeserializeToObject"; 20360 [labelType="html" label="MapPartitionsRDD [20360]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45545 { label="MapPartitions"; 20361 [labelType="html" label="MapPartitionsRDD [20361]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45555 { label="mapPartitions"; 20363 [labelType="html" label="MapPartitionsRDD [20363]<br>toJavaRDD at <unknown>:0"]; } } 20350->20351; 20351->20352; 20352->20353; 20353->20354; 20354->20355; 20355->20356; 20356->20357; 20357->20358; 20358->20359; 20359->20360; 20360->20361; 20361->20362; 20362->20363; 20363->20364; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time