3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1651 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 447
Associated Job Ids:
1652
DAG Visualization
digraph G { subgraph clusterstage_1651 { label="Stage 1651"; 17351 [labelType="html" label="SQLExecutionRDD [17351]<br>run at <unknown>:0"]; 17359 [labelType="html" label="SQLExecutionRDD [17359]<br>toJavaRDD at <unknown>:0"]; 17361 [labelType="html" label="PythonRDD [17361]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster38823 { label="MicroBatchScan"; 17347 [labelType="html" label="DataSourceRDD [17347]<br>run at <unknown>:0"]; 17348 [labelType="html" label="MapPartitionsRDD [17348]<br>run at <unknown>:0"]; } subgraph cluster38822 { label="Project"; 17349 [labelType="html" label="MapPartitionsRDD [17349]<br>run at <unknown>:0"]; } subgraph cluster38818 { label="WholeStageCodegen (1)"; 17350 [labelType="html" label="MapPartitionsRDD [17350]<br>run at <unknown>:0"]; } subgraph cluster38832 { label="WholeStageCodegen (1)"; 17352 [labelType="html" label="MapPartitionsRDD [17352]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38831 { label="Filter"; 17353 [labelType="html" label="MapPartitionsRDD [17353]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38830 { label="Project"; 17354 [labelType="html" label="MapPartitionsRDD [17354]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38827 { label="WholeStageCodegen (2)"; 17355 [labelType="html" label="MapPartitionsRDD [17355]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38826 { label="Project"; 17356 [labelType="html" label="MapPartitionsRDD [17356]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38825 { label="DeserializeToObject"; 17357 [labelType="html" label="MapPartitionsRDD [17357]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38824 { label="MapPartitions"; 17358 [labelType="html" label="MapPartitionsRDD [17358]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38834 { label="mapPartitions"; 17360 [labelType="html" label="MapPartitionsRDD [17360]<br>toJavaRDD at <unknown>:0"]; } } 17347->17348; 17348->17349; 17349->17350; 17350->17351; 17351->17352; 17352->17353; 17353->17354; 17354->17355; 17355->17356; 17356->17357; 17357->17358; 17358->17359; 17359->17360; 17360->17361; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time