3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 403 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 418
Associated Job Ids:
403
DAG Visualization
digraph G { subgraph clusterstage_403 { label="Stage 403"; 4225 [labelType="html" label="SQLExecutionRDD [4225]<br>run at <unknown>:0"]; 4239 [labelType="html" label="SQLExecutionRDD [4239]<br>toJavaRDD at <unknown>:0"]; 4241 [labelType="html" label="PythonRDD [4241]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9452 { label="MicroBatchScan"; 4221 [labelType="html" label="DataSourceRDD [4221]<br>run at <unknown>:0"]; 4222 [labelType="html" label="MapPartitionsRDD [4222]<br>run at <unknown>:0"]; } subgraph cluster9451 { label="Project"; 4223 [labelType="html" label="MapPartitionsRDD [4223]<br>run at <unknown>:0"]; } subgraph cluster9447 { label="WholeStageCodegen (1)"; 4224 [labelType="html" label="MapPartitionsRDD [4224]<br>run at <unknown>:0"]; } subgraph cluster9469 { label="WholeStageCodegen (1)"; 4232 [labelType="html" label="MapPartitionsRDD [4232]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9468 { label="Filter"; 4233 [labelType="html" label="MapPartitionsRDD [4233]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9467 { label="Project"; 4234 [labelType="html" label="MapPartitionsRDD [4234]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9464 { label="WholeStageCodegen (2)"; 4235 [labelType="html" label="MapPartitionsRDD [4235]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9463 { label="Project"; 4236 [labelType="html" label="MapPartitionsRDD [4236]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9462 { label="DeserializeToObject"; 4237 [labelType="html" label="MapPartitionsRDD [4237]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9461 { label="MapPartitions"; 4238 [labelType="html" label="MapPartitionsRDD [4238]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9471 { label="mapPartitions"; 4240 [labelType="html" label="MapPartitionsRDD [4240]<br>toJavaRDD at <unknown>:0"]; } } 4221->4222; 4222->4223; 4223->4224; 4224->4225; 4225->4232; 4232->4233; 4233->4234; 4234->4235; 4235->4236; 4236->4237; 4237->4238; 4238->4239; 4239->4240; 4240->4241; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time