3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 226 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 356
Associated Job Ids:
226
DAG Visualization
digraph G { subgraph clusterstage_226 { label="Stage 226"; 2377 [labelType="html" label="SQLExecutionRDD [2377]<br>run at <unknown>:0"]; 2385 [labelType="html" label="SQLExecutionRDD [2385]<br>toJavaRDD at <unknown>:0"]; 2387 [labelType="html" label="PythonRDD [2387]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster5316 { label="MicroBatchScan"; 2373 [labelType="html" label="DataSourceRDD [2373]<br>run at <unknown>:0"]; 2374 [labelType="html" label="MapPartitionsRDD [2374]<br>run at <unknown>:0"]; } subgraph cluster5315 { label="Project"; 2375 [labelType="html" label="MapPartitionsRDD [2375]<br>run at <unknown>:0"]; } subgraph cluster5311 { label="WholeStageCodegen (1)"; 2376 [labelType="html" label="MapPartitionsRDD [2376]<br>run at <unknown>:0"]; } subgraph cluster5325 { label="WholeStageCodegen (1)"; 2378 [labelType="html" label="MapPartitionsRDD [2378]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5324 { label="Filter"; 2379 [labelType="html" label="MapPartitionsRDD [2379]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5323 { label="Project"; 2380 [labelType="html" label="MapPartitionsRDD [2380]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5320 { label="WholeStageCodegen (2)"; 2381 [labelType="html" label="MapPartitionsRDD [2381]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5319 { label="Project"; 2382 [labelType="html" label="MapPartitionsRDD [2382]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5318 { label="DeserializeToObject"; 2383 [labelType="html" label="MapPartitionsRDD [2383]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5317 { label="MapPartitions"; 2384 [labelType="html" label="MapPartitionsRDD [2384]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5327 { label="mapPartitions"; 2386 [labelType="html" label="MapPartitionsRDD [2386]<br>toJavaRDD at <unknown>:0"]; } } 2373->2374; 2374->2375; 2375->2376; 2376->2377; 2377->2378; 2378->2379; 2379->2380; 2380->2381; 2381->2382; 2382->2383; 2383->2384; 2384->2385; 2385->2386; 2386->2387; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time