3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1429 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 461
Associated Job Ids:
1430
DAG Visualization
digraph G { subgraph clusterstage_1429 { label="Stage 1429"; 15020 [labelType="html" label="SQLExecutionRDD [15020]<br>run at <unknown>:0"]; 15028 [labelType="html" label="SQLExecutionRDD [15028]<br>toJavaRDD at <unknown>:0"]; 15030 [labelType="html" label="PythonRDD [15030]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster33606 { label="MicroBatchScan"; 15016 [labelType="html" label="DataSourceRDD [15016]<br>run at <unknown>:0"]; 15017 [labelType="html" label="MapPartitionsRDD [15017]<br>run at <unknown>:0"]; } subgraph cluster33605 { label="Project"; 15018 [labelType="html" label="MapPartitionsRDD [15018]<br>run at <unknown>:0"]; } subgraph cluster33601 { label="WholeStageCodegen (1)"; 15019 [labelType="html" label="MapPartitionsRDD [15019]<br>run at <unknown>:0"]; } subgraph cluster33615 { label="WholeStageCodegen (1)"; 15021 [labelType="html" label="MapPartitionsRDD [15021]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33614 { label="Filter"; 15022 [labelType="html" label="MapPartitionsRDD [15022]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33613 { label="Project"; 15023 [labelType="html" label="MapPartitionsRDD [15023]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33610 { label="WholeStageCodegen (2)"; 15024 [labelType="html" label="MapPartitionsRDD [15024]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33609 { label="Project"; 15025 [labelType="html" label="MapPartitionsRDD [15025]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33608 { label="DeserializeToObject"; 15026 [labelType="html" label="MapPartitionsRDD [15026]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33607 { label="MapPartitions"; 15027 [labelType="html" label="MapPartitionsRDD [15027]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33617 { label="mapPartitions"; 15029 [labelType="html" label="MapPartitionsRDD [15029]<br>toJavaRDD at <unknown>:0"]; } } 15016->15017; 15017->15018; 15018->15019; 15019->15020; 15020->15021; 15021->15022; 15022->15023; 15023->15024; 15024->15025; 15025->15026; 15026->15027; 15027->15028; 15028->15029; 15029->15030; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time