3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 208 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 427
Associated Job Ids:
208
DAG Visualization
digraph G { subgraph clusterstage_208 { label="Stage 208"; 2188 [labelType="html" label="SQLExecutionRDD [2188]<br>run at <unknown>:0"]; 2196 [labelType="html" label="SQLExecutionRDD [2196]<br>toJavaRDD at <unknown>:0"]; 2198 [labelType="html" label="PythonRDD [2198]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4893 { label="MicroBatchScan"; 2184 [labelType="html" label="DataSourceRDD [2184]<br>run at <unknown>:0"]; 2185 [labelType="html" label="MapPartitionsRDD [2185]<br>run at <unknown>:0"]; } subgraph cluster4892 { label="Project"; 2186 [labelType="html" label="MapPartitionsRDD [2186]<br>run at <unknown>:0"]; } subgraph cluster4888 { label="WholeStageCodegen (1)"; 2187 [labelType="html" label="MapPartitionsRDD [2187]<br>run at <unknown>:0"]; } subgraph cluster4902 { label="WholeStageCodegen (1)"; 2189 [labelType="html" label="MapPartitionsRDD [2189]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4901 { label="Filter"; 2190 [labelType="html" label="MapPartitionsRDD [2190]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4900 { label="Project"; 2191 [labelType="html" label="MapPartitionsRDD [2191]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4897 { label="WholeStageCodegen (2)"; 2192 [labelType="html" label="MapPartitionsRDD [2192]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4896 { label="Project"; 2193 [labelType="html" label="MapPartitionsRDD [2193]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4895 { label="DeserializeToObject"; 2194 [labelType="html" label="MapPartitionsRDD [2194]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4894 { label="MapPartitions"; 2195 [labelType="html" label="MapPartitionsRDD [2195]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4904 { label="mapPartitions"; 2197 [labelType="html" label="MapPartitionsRDD [2197]<br>toJavaRDD at <unknown>:0"]; } } 2184->2185; 2185->2186; 2186->2187; 2187->2188; 2188->2189; 2189->2190; 2190->2191; 2191->2192; 2192->2193; 2193->2194; 2194->2195; 2195->2196; 2196->2197; 2197->2198; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time