3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1619 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 439
Associated Job Ids:
1620
DAG Visualization
digraph G { subgraph clusterstage_1619 { label="Stage 1619"; 17015 [labelType="html" label="SQLExecutionRDD [17015]<br>run at <unknown>:0"]; 17023 [labelType="html" label="SQLExecutionRDD [17023]<br>toJavaRDD at <unknown>:0"]; 17025 [labelType="html" label="PythonRDD [17025]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster38071 { label="MicroBatchScan"; 17011 [labelType="html" label="DataSourceRDD [17011]<br>run at <unknown>:0"]; 17012 [labelType="html" label="MapPartitionsRDD [17012]<br>run at <unknown>:0"]; } subgraph cluster38070 { label="Project"; 17013 [labelType="html" label="MapPartitionsRDD [17013]<br>run at <unknown>:0"]; } subgraph cluster38066 { label="WholeStageCodegen (1)"; 17014 [labelType="html" label="MapPartitionsRDD [17014]<br>run at <unknown>:0"]; } subgraph cluster38080 { label="WholeStageCodegen (1)"; 17016 [labelType="html" label="MapPartitionsRDD [17016]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38079 { label="Filter"; 17017 [labelType="html" label="MapPartitionsRDD [17017]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38078 { label="Project"; 17018 [labelType="html" label="MapPartitionsRDD [17018]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38075 { label="WholeStageCodegen (2)"; 17019 [labelType="html" label="MapPartitionsRDD [17019]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38074 { label="Project"; 17020 [labelType="html" label="MapPartitionsRDD [17020]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38073 { label="DeserializeToObject"; 17021 [labelType="html" label="MapPartitionsRDD [17021]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38072 { label="MapPartitions"; 17022 [labelType="html" label="MapPartitionsRDD [17022]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster38082 { label="mapPartitions"; 17024 [labelType="html" label="MapPartitionsRDD [17024]<br>toJavaRDD at <unknown>:0"]; } } 17011->17012; 17012->17013; 17013->17014; 17014->17015; 17015->17016; 17016->17017; 17017->17018; 17018->17019; 17019->17020; 17020->17021; 17021->17022; 17022->17023; 17023->17024; 17024->17025; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time