3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 213 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 467
Associated Job Ids:
213
DAG Visualization
digraph G { subgraph clusterstage_213 { label="Stage 213"; 2230 [labelType="html" label="SQLExecutionRDD [2230]<br>run at <unknown>:0"]; 2244 [labelType="html" label="SQLExecutionRDD [2244]<br>toJavaRDD at <unknown>:0"]; 2246 [labelType="html" label="PythonRDD [2246]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4987 { label="MicroBatchScan"; 2226 [labelType="html" label="DataSourceRDD [2226]<br>run at <unknown>:0"]; 2227 [labelType="html" label="MapPartitionsRDD [2227]<br>run at <unknown>:0"]; } subgraph cluster4986 { label="Project"; 2228 [labelType="html" label="MapPartitionsRDD [2228]<br>run at <unknown>:0"]; } subgraph cluster4982 { label="WholeStageCodegen (1)"; 2229 [labelType="html" label="MapPartitionsRDD [2229]<br>run at <unknown>:0"]; } subgraph cluster5004 { label="WholeStageCodegen (1)"; 2237 [labelType="html" label="MapPartitionsRDD [2237]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5003 { label="Filter"; 2238 [labelType="html" label="MapPartitionsRDD [2238]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5002 { label="Project"; 2239 [labelType="html" label="MapPartitionsRDD [2239]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4999 { label="WholeStageCodegen (2)"; 2240 [labelType="html" label="MapPartitionsRDD [2240]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4998 { label="Project"; 2241 [labelType="html" label="MapPartitionsRDD [2241]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4997 { label="DeserializeToObject"; 2242 [labelType="html" label="MapPartitionsRDD [2242]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4996 { label="MapPartitions"; 2243 [labelType="html" label="MapPartitionsRDD [2243]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5006 { label="mapPartitions"; 2245 [labelType="html" label="MapPartitionsRDD [2245]<br>toJavaRDD at <unknown>:0"]; } } 2226->2227; 2227->2228; 2228->2229; 2229->2230; 2230->2237; 2237->2238; 2238->2239; 2239->2240; 2240->2241; 2241->2242; 2242->2243; 2243->2244; 2244->2245; 2245->2246; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time