3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 339 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 363
Associated Job Ids:
339
DAG Visualization
digraph G { subgraph clusterstage_339 { label="Stage 339"; 3559 [labelType="html" label="SQLExecutionRDD [3559]<br>run at <unknown>:0"]; 3567 [labelType="html" label="SQLExecutionRDD [3567]<br>toJavaRDD at <unknown>:0"]; 3569 [labelType="html" label="PythonRDD [3569]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7956 { label="MicroBatchScan"; 3555 [labelType="html" label="DataSourceRDD [3555]<br>run at <unknown>:0"]; 3556 [labelType="html" label="MapPartitionsRDD [3556]<br>run at <unknown>:0"]; } subgraph cluster7955 { label="Project"; 3557 [labelType="html" label="MapPartitionsRDD [3557]<br>run at <unknown>:0"]; } subgraph cluster7951 { label="WholeStageCodegen (1)"; 3558 [labelType="html" label="MapPartitionsRDD [3558]<br>run at <unknown>:0"]; } subgraph cluster7965 { label="WholeStageCodegen (1)"; 3560 [labelType="html" label="MapPartitionsRDD [3560]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7964 { label="Filter"; 3561 [labelType="html" label="MapPartitionsRDD [3561]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7963 { label="Project"; 3562 [labelType="html" label="MapPartitionsRDD [3562]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7960 { label="WholeStageCodegen (2)"; 3563 [labelType="html" label="MapPartitionsRDD [3563]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7959 { label="Project"; 3564 [labelType="html" label="MapPartitionsRDD [3564]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7958 { label="DeserializeToObject"; 3565 [labelType="html" label="MapPartitionsRDD [3565]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7957 { label="MapPartitions"; 3566 [labelType="html" label="MapPartitionsRDD [3566]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7967 { label="mapPartitions"; 3568 [labelType="html" label="MapPartitionsRDD [3568]<br>toJavaRDD at <unknown>:0"]; } } 3555->3556; 3556->3557; 3557->3558; 3558->3559; 3559->3560; 3560->3561; 3561->3562; 3562->3563; 3563->3564; 3564->3565; 3565->3566; 3566->3567; 3567->3568; 3568->3569; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time