3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 407 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 396
Associated Job Ids:
407
DAG Visualization
digraph G { subgraph clusterstage_407 { label="Stage 407"; 4273 [labelType="html" label="SQLExecutionRDD [4273]<br>run at <unknown>:0"]; 4281 [labelType="html" label="SQLExecutionRDD [4281]<br>toJavaRDD at <unknown>:0"]; 4283 [labelType="html" label="PythonRDD [4283]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9554 { label="MicroBatchScan"; 4269 [labelType="html" label="DataSourceRDD [4269]<br>run at <unknown>:0"]; 4270 [labelType="html" label="MapPartitionsRDD [4270]<br>run at <unknown>:0"]; } subgraph cluster9553 { label="Project"; 4271 [labelType="html" label="MapPartitionsRDD [4271]<br>run at <unknown>:0"]; } subgraph cluster9549 { label="WholeStageCodegen (1)"; 4272 [labelType="html" label="MapPartitionsRDD [4272]<br>run at <unknown>:0"]; } subgraph cluster9563 { label="WholeStageCodegen (1)"; 4274 [labelType="html" label="MapPartitionsRDD [4274]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9562 { label="Filter"; 4275 [labelType="html" label="MapPartitionsRDD [4275]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9561 { label="Project"; 4276 [labelType="html" label="MapPartitionsRDD [4276]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9558 { label="WholeStageCodegen (2)"; 4277 [labelType="html" label="MapPartitionsRDD [4277]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9557 { label="Project"; 4278 [labelType="html" label="MapPartitionsRDD [4278]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9556 { label="DeserializeToObject"; 4279 [labelType="html" label="MapPartitionsRDD [4279]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9555 { label="MapPartitions"; 4280 [labelType="html" label="MapPartitionsRDD [4280]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9565 { label="mapPartitions"; 4282 [labelType="html" label="MapPartitionsRDD [4282]<br>toJavaRDD at <unknown>:0"]; } } 4269->4270; 4270->4271; 4271->4272; 4272->4273; 4273->4274; 4274->4275; 4275->4276; 4276->4277; 4277->4278; 4278->4279; 4279->4280; 4280->4281; 4281->4282; 4282->4283; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time