3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1758 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 441
Associated Job Ids:
1758
DAG Visualization
digraph G { subgraph clusterstage_1758 { label="Stage 1758"; 18463 [labelType="html" label="SQLExecutionRDD [18463]<br>run at <unknown>:0"]; 18471 [labelType="html" label="SQLExecutionRDD [18471]<br>toJavaRDD at <unknown>:0"]; 18473 [labelType="html" label="PythonRDD [18473]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster41318 { label="MicroBatchScan"; 18459 [labelType="html" label="DataSourceRDD [18459]<br>run at <unknown>:0"]; 18460 [labelType="html" label="MapPartitionsRDD [18460]<br>run at <unknown>:0"]; } subgraph cluster41317 { label="Project"; 18461 [labelType="html" label="MapPartitionsRDD [18461]<br>run at <unknown>:0"]; } subgraph cluster41313 { label="WholeStageCodegen (1)"; 18462 [labelType="html" label="MapPartitionsRDD [18462]<br>run at <unknown>:0"]; } subgraph cluster41327 { label="WholeStageCodegen (1)"; 18464 [labelType="html" label="MapPartitionsRDD [18464]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41326 { label="Filter"; 18465 [labelType="html" label="MapPartitionsRDD [18465]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41325 { label="Project"; 18466 [labelType="html" label="MapPartitionsRDD [18466]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41322 { label="WholeStageCodegen (2)"; 18467 [labelType="html" label="MapPartitionsRDD [18467]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41321 { label="Project"; 18468 [labelType="html" label="MapPartitionsRDD [18468]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41320 { label="DeserializeToObject"; 18469 [labelType="html" label="MapPartitionsRDD [18469]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41319 { label="MapPartitions"; 18470 [labelType="html" label="MapPartitionsRDD [18470]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41329 { label="mapPartitions"; 18472 [labelType="html" label="MapPartitionsRDD [18472]<br>toJavaRDD at <unknown>:0"]; } } 18459->18460; 18460->18461; 18461->18462; 18462->18463; 18463->18464; 18464->18465; 18465->18466; 18466->18467; 18467->18468; 18468->18469; 18469->18470; 18470->18471; 18471->18472; 18472->18473; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time