3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1105 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 612
Associated Job Ids:
1106
DAG Visualization
digraph G { subgraph clusterstage_1105 { label="Stage 1105"; 11618 [labelType="html" label="SQLExecutionRDD [11618]<br>run at <unknown>:0"]; 11626 [labelType="html" label="SQLExecutionRDD [11626]<br>toJavaRDD at <unknown>:0"]; 11628 [labelType="html" label="PythonRDD [11628]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster25992 { label="MicroBatchScan"; 11614 [labelType="html" label="DataSourceRDD [11614]<br>run at <unknown>:0"]; 11615 [labelType="html" label="MapPartitionsRDD [11615]<br>run at <unknown>:0"]; } subgraph cluster25991 { label="Project"; 11616 [labelType="html" label="MapPartitionsRDD [11616]<br>run at <unknown>:0"]; } subgraph cluster25987 { label="WholeStageCodegen (1)"; 11617 [labelType="html" label="MapPartitionsRDD [11617]<br>run at <unknown>:0"]; } subgraph cluster26001 { label="WholeStageCodegen (1)"; 11619 [labelType="html" label="MapPartitionsRDD [11619]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26000 { label="Filter"; 11620 [labelType="html" label="MapPartitionsRDD [11620]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25999 { label="Project"; 11621 [labelType="html" label="MapPartitionsRDD [11621]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25996 { label="WholeStageCodegen (2)"; 11622 [labelType="html" label="MapPartitionsRDD [11622]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25995 { label="Project"; 11623 [labelType="html" label="MapPartitionsRDD [11623]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25994 { label="DeserializeToObject"; 11624 [labelType="html" label="MapPartitionsRDD [11624]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25993 { label="MapPartitions"; 11625 [labelType="html" label="MapPartitionsRDD [11625]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26003 { label="mapPartitions"; 11627 [labelType="html" label="MapPartitionsRDD [11627]<br>toJavaRDD at <unknown>:0"]; } } 11614->11615; 11615->11616; 11616->11617; 11617->11618; 11618->11619; 11619->11620; 11620->11621; 11621->11622; 11622->11623; 11623->11624; 11624->11625; 11625->11626; 11626->11627; 11627->11628; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time