3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1316 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 435
Associated Job Ids:
1316
DAG Visualization
digraph G { subgraph clusterstage_1316 { label="Stage 1316"; 13822 [labelType="html" label="SQLExecutionRDD [13822]<br>run at <unknown>:0"]; 13830 [labelType="html" label="SQLExecutionRDD [13830]<br>toJavaRDD at <unknown>:0"]; 13832 [labelType="html" label="PythonRDD [13832]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30931 { label="MicroBatchScan"; 13818 [labelType="html" label="DataSourceRDD [13818]<br>run at <unknown>:0"]; 13819 [labelType="html" label="MapPartitionsRDD [13819]<br>run at <unknown>:0"]; } subgraph cluster30930 { label="Project"; 13820 [labelType="html" label="MapPartitionsRDD [13820]<br>run at <unknown>:0"]; } subgraph cluster30926 { label="WholeStageCodegen (1)"; 13821 [labelType="html" label="MapPartitionsRDD [13821]<br>run at <unknown>:0"]; } subgraph cluster30940 { label="WholeStageCodegen (1)"; 13823 [labelType="html" label="MapPartitionsRDD [13823]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30939 { label="Filter"; 13824 [labelType="html" label="MapPartitionsRDD [13824]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30938 { label="Project"; 13825 [labelType="html" label="MapPartitionsRDD [13825]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30935 { label="WholeStageCodegen (2)"; 13826 [labelType="html" label="MapPartitionsRDD [13826]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30934 { label="Project"; 13827 [labelType="html" label="MapPartitionsRDD [13827]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30933 { label="DeserializeToObject"; 13828 [labelType="html" label="MapPartitionsRDD [13828]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30932 { label="MapPartitions"; 13829 [labelType="html" label="MapPartitionsRDD [13829]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30942 { label="mapPartitions"; 13831 [labelType="html" label="MapPartitionsRDD [13831]<br>toJavaRDD at <unknown>:0"]; } } 13818->13819; 13819->13820; 13820->13821; 13821->13822; 13822->13823; 13823->13824; 13824->13825; 13825->13826; 13826->13827; 13827->13828; 13828->13829; 13829->13830; 13830->13831; 13831->13832; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time