3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1065 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 510
Associated Job Ids:
1066
DAG Visualization
digraph G { subgraph clusterstage_1065 { label="Stage 1065"; 11198 [labelType="html" label="SQLExecutionRDD [11198]<br>run at <unknown>:0"]; 11206 [labelType="html" label="SQLExecutionRDD [11206]<br>toJavaRDD at <unknown>:0"]; 11208 [labelType="html" label="PythonRDD [11208]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster25052 { label="MicroBatchScan"; 11194 [labelType="html" label="DataSourceRDD [11194]<br>run at <unknown>:0"]; 11195 [labelType="html" label="MapPartitionsRDD [11195]<br>run at <unknown>:0"]; } subgraph cluster25051 { label="Project"; 11196 [labelType="html" label="MapPartitionsRDD [11196]<br>run at <unknown>:0"]; } subgraph cluster25047 { label="WholeStageCodegen (1)"; 11197 [labelType="html" label="MapPartitionsRDD [11197]<br>run at <unknown>:0"]; } subgraph cluster25061 { label="WholeStageCodegen (1)"; 11199 [labelType="html" label="MapPartitionsRDD [11199]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25060 { label="Filter"; 11200 [labelType="html" label="MapPartitionsRDD [11200]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25059 { label="Project"; 11201 [labelType="html" label="MapPartitionsRDD [11201]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25056 { label="WholeStageCodegen (2)"; 11202 [labelType="html" label="MapPartitionsRDD [11202]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25055 { label="Project"; 11203 [labelType="html" label="MapPartitionsRDD [11203]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25054 { label="DeserializeToObject"; 11204 [labelType="html" label="MapPartitionsRDD [11204]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25053 { label="MapPartitions"; 11205 [labelType="html" label="MapPartitionsRDD [11205]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25063 { label="mapPartitions"; 11207 [labelType="html" label="MapPartitionsRDD [11207]<br>toJavaRDD at <unknown>:0"]; } } 11194->11195; 11195->11196; 11196->11197; 11197->11198; 11198->11199; 11199->11200; 11200->11201; 11201->11202; 11202->11203; 11203->11204; 11204->11205; 11205->11206; 11206->11207; 11207->11208; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time