3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1281 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 421
Associated Job Ids:
1281
DAG Visualization
digraph G { subgraph clusterstage_1281 { label="Stage 1281"; 13444 [labelType="html" label="SQLExecutionRDD [13444]<br>run at <unknown>:0"]; 13458 [labelType="html" label="SQLExecutionRDD [13458]<br>toJavaRDD at <unknown>:0"]; 13460 [labelType="html" label="PythonRDD [13460]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30085 { label="MicroBatchScan"; 13440 [labelType="html" label="DataSourceRDD [13440]<br>run at <unknown>:0"]; 13441 [labelType="html" label="MapPartitionsRDD [13441]<br>run at <unknown>:0"]; } subgraph cluster30084 { label="Project"; 13442 [labelType="html" label="MapPartitionsRDD [13442]<br>run at <unknown>:0"]; } subgraph cluster30080 { label="WholeStageCodegen (1)"; 13443 [labelType="html" label="MapPartitionsRDD [13443]<br>run at <unknown>:0"]; } subgraph cluster30102 { label="WholeStageCodegen (1)"; 13451 [labelType="html" label="MapPartitionsRDD [13451]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30101 { label="Filter"; 13452 [labelType="html" label="MapPartitionsRDD [13452]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30100 { label="Project"; 13453 [labelType="html" label="MapPartitionsRDD [13453]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30097 { label="WholeStageCodegen (2)"; 13454 [labelType="html" label="MapPartitionsRDD [13454]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30096 { label="Project"; 13455 [labelType="html" label="MapPartitionsRDD [13455]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30095 { label="DeserializeToObject"; 13456 [labelType="html" label="MapPartitionsRDD [13456]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30094 { label="MapPartitions"; 13457 [labelType="html" label="MapPartitionsRDD [13457]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30104 { label="mapPartitions"; 13459 [labelType="html" label="MapPartitionsRDD [13459]<br>toJavaRDD at <unknown>:0"]; } } 13440->13441; 13441->13442; 13442->13443; 13443->13444; 13444->13451; 13451->13452; 13452->13453; 13453->13454; 13454->13455; 13455->13456; 13456->13457; 13457->13458; 13458->13459; 13459->13460; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time