3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1502 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 408
Associated Job Ids:
1502
DAG Visualization
digraph G { subgraph clusterstage_1502 { label="Stage 1502"; 15775 [labelType="html" label="SQLExecutionRDD [15775]<br>run at <unknown>:0"]; 15783 [labelType="html" label="SQLExecutionRDD [15783]<br>toJavaRDD at <unknown>:0"]; 15788 [labelType="html" label="PythonRDD [15788]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster35302 { label="MicroBatchScan"; 15771 [labelType="html" label="DataSourceRDD [15771]<br>run at <unknown>:0"]; 15772 [labelType="html" label="MapPartitionsRDD [15772]<br>run at <unknown>:0"]; } subgraph cluster35301 { label="Project"; 15773 [labelType="html" label="MapPartitionsRDD [15773]<br>run at <unknown>:0"]; } subgraph cluster35297 { label="WholeStageCodegen (1)"; 15774 [labelType="html" label="MapPartitionsRDD [15774]<br>run at <unknown>:0"]; } subgraph cluster35311 { label="WholeStageCodegen (1)"; 15776 [labelType="html" label="MapPartitionsRDD [15776]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35310 { label="Filter"; 15777 [labelType="html" label="MapPartitionsRDD [15777]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35309 { label="Project"; 15778 [labelType="html" label="MapPartitionsRDD [15778]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35306 { label="WholeStageCodegen (2)"; 15779 [labelType="html" label="MapPartitionsRDD [15779]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35305 { label="Project"; 15780 [labelType="html" label="MapPartitionsRDD [15780]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35304 { label="DeserializeToObject"; 15781 [labelType="html" label="MapPartitionsRDD [15781]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35303 { label="MapPartitions"; 15782 [labelType="html" label="MapPartitionsRDD [15782]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster35319 { label="mapPartitions"; 15784 [labelType="html" label="MapPartitionsRDD [15784]<br>toJavaRDD at <unknown>:0"]; } } 15771->15772; 15772->15773; 15773->15774; 15774->15775; 15775->15776; 15776->15777; 15777->15778; 15778->15779; 15779->15780; 15780->15781; 15781->15782; 15782->15783; 15783->15784; 15784->15788; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time