3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 408 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 470
Associated Job Ids:
408
DAG Visualization
digraph G { subgraph clusterstage_408 { label="Stage 408"; 4288 [labelType="html" label="SQLExecutionRDD [4288]<br>run at <unknown>:0"]; 4296 [labelType="html" label="SQLExecutionRDD [4296]<br>toJavaRDD at <unknown>:0"]; 4298 [labelType="html" label="PythonRDD [4298]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9593 { label="MicroBatchScan"; 4284 [labelType="html" label="DataSourceRDD [4284]<br>run at <unknown>:0"]; 4285 [labelType="html" label="MapPartitionsRDD [4285]<br>run at <unknown>:0"]; } subgraph cluster9592 { label="Project"; 4286 [labelType="html" label="MapPartitionsRDD [4286]<br>run at <unknown>:0"]; } subgraph cluster9588 { label="WholeStageCodegen (1)"; 4287 [labelType="html" label="MapPartitionsRDD [4287]<br>run at <unknown>:0"]; } subgraph cluster9602 { label="WholeStageCodegen (1)"; 4289 [labelType="html" label="MapPartitionsRDD [4289]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9601 { label="Filter"; 4290 [labelType="html" label="MapPartitionsRDD [4290]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9600 { label="Project"; 4291 [labelType="html" label="MapPartitionsRDD [4291]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9597 { label="WholeStageCodegen (2)"; 4292 [labelType="html" label="MapPartitionsRDD [4292]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9596 { label="Project"; 4293 [labelType="html" label="MapPartitionsRDD [4293]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9595 { label="DeserializeToObject"; 4294 [labelType="html" label="MapPartitionsRDD [4294]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9594 { label="MapPartitions"; 4295 [labelType="html" label="MapPartitionsRDD [4295]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9604 { label="mapPartitions"; 4297 [labelType="html" label="MapPartitionsRDD [4297]<br>toJavaRDD at <unknown>:0"]; } } 4284->4285; 4285->4286; 4286->4287; 4287->4288; 4288->4289; 4289->4290; 4290->4291; 4291->4292; 4292->4293; 4293->4294; 4294->4295; 4295->4296; 4296->4297; 4297->4298; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time