3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1922 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 428
Associated Job Ids:
1922
DAG Visualization
digraph G { subgraph clusterstage_1922 { label="Stage 1922"; 20185 [labelType="html" label="SQLExecutionRDD [20185]<br>run at <unknown>:0"]; 20193 [labelType="html" label="SQLExecutionRDD [20193]<br>toJavaRDD at <unknown>:0"]; 20195 [labelType="html" label="PythonRDD [20195]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster45172 { label="MicroBatchScan"; 20181 [labelType="html" label="DataSourceRDD [20181]<br>run at <unknown>:0"]; 20182 [labelType="html" label="MapPartitionsRDD [20182]<br>run at <unknown>:0"]; } subgraph cluster45171 { label="Project"; 20183 [labelType="html" label="MapPartitionsRDD [20183]<br>run at <unknown>:0"]; } subgraph cluster45167 { label="WholeStageCodegen (1)"; 20184 [labelType="html" label="MapPartitionsRDD [20184]<br>run at <unknown>:0"]; } subgraph cluster45181 { label="WholeStageCodegen (1)"; 20186 [labelType="html" label="MapPartitionsRDD [20186]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45180 { label="Filter"; 20187 [labelType="html" label="MapPartitionsRDD [20187]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45179 { label="Project"; 20188 [labelType="html" label="MapPartitionsRDD [20188]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45176 { label="WholeStageCodegen (2)"; 20189 [labelType="html" label="MapPartitionsRDD [20189]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45175 { label="Project"; 20190 [labelType="html" label="MapPartitionsRDD [20190]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45174 { label="DeserializeToObject"; 20191 [labelType="html" label="MapPartitionsRDD [20191]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45173 { label="MapPartitions"; 20192 [labelType="html" label="MapPartitionsRDD [20192]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45183 { label="mapPartitions"; 20194 [labelType="html" label="MapPartitionsRDD [20194]<br>toJavaRDD at <unknown>:0"]; } } 20181->20182; 20182->20183; 20183->20184; 20184->20185; 20185->20186; 20186->20187; 20187->20188; 20188->20189; 20189->20190; 20190->20191; 20191->20192; 20192->20193; 20193->20194; 20194->20195; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time