3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 520 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 486
Associated Job Ids:
520
DAG Visualization
digraph G { subgraph clusterstage_520 { label="Stage 520"; 5464 [labelType="html" label="SQLExecutionRDD [5464]<br>run at <unknown>:0"]; 5472 [labelType="html" label="SQLExecutionRDD [5472]<br>toJavaRDD at <unknown>:0"]; 5474 [labelType="html" label="PythonRDD [5474]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12225 { label="MicroBatchScan"; 5460 [labelType="html" label="DataSourceRDD [5460]<br>run at <unknown>:0"]; 5461 [labelType="html" label="MapPartitionsRDD [5461]<br>run at <unknown>:0"]; } subgraph cluster12224 { label="Project"; 5462 [labelType="html" label="MapPartitionsRDD [5462]<br>run at <unknown>:0"]; } subgraph cluster12220 { label="WholeStageCodegen (1)"; 5463 [labelType="html" label="MapPartitionsRDD [5463]<br>run at <unknown>:0"]; } subgraph cluster12234 { label="WholeStageCodegen (1)"; 5465 [labelType="html" label="MapPartitionsRDD [5465]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12233 { label="Filter"; 5466 [labelType="html" label="MapPartitionsRDD [5466]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12232 { label="Project"; 5467 [labelType="html" label="MapPartitionsRDD [5467]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12229 { label="WholeStageCodegen (2)"; 5468 [labelType="html" label="MapPartitionsRDD [5468]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12228 { label="Project"; 5469 [labelType="html" label="MapPartitionsRDD [5469]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12227 { label="DeserializeToObject"; 5470 [labelType="html" label="MapPartitionsRDD [5470]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12226 { label="MapPartitions"; 5471 [labelType="html" label="MapPartitionsRDD [5471]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12236 { label="mapPartitions"; 5473 [labelType="html" label="MapPartitionsRDD [5473]<br>toJavaRDD at <unknown>:0"]; } } 5460->5461; 5461->5462; 5462->5463; 5463->5464; 5464->5465; 5465->5466; 5466->5467; 5467->5468; 5468->5469; 5469->5470; 5470->5471; 5471->5472; 5472->5473; 5473->5474; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time