3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 478 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 389
Associated Job Ids:
478
DAG Visualization
digraph G { subgraph clusterstage_478 { label="Stage 478"; 5023 [labelType="html" label="SQLExecutionRDD [5023]<br>run at <unknown>:0"]; 5031 [labelType="html" label="SQLExecutionRDD [5031]<br>toJavaRDD at <unknown>:0"]; 5033 [labelType="html" label="PythonRDD [5033]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster11238 { label="MicroBatchScan"; 5019 [labelType="html" label="DataSourceRDD [5019]<br>run at <unknown>:0"]; 5020 [labelType="html" label="MapPartitionsRDD [5020]<br>run at <unknown>:0"]; } subgraph cluster11237 { label="Project"; 5021 [labelType="html" label="MapPartitionsRDD [5021]<br>run at <unknown>:0"]; } subgraph cluster11233 { label="WholeStageCodegen (1)"; 5022 [labelType="html" label="MapPartitionsRDD [5022]<br>run at <unknown>:0"]; } subgraph cluster11247 { label="WholeStageCodegen (1)"; 5024 [labelType="html" label="MapPartitionsRDD [5024]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11246 { label="Filter"; 5025 [labelType="html" label="MapPartitionsRDD [5025]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11245 { label="Project"; 5026 [labelType="html" label="MapPartitionsRDD [5026]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11242 { label="WholeStageCodegen (2)"; 5027 [labelType="html" label="MapPartitionsRDD [5027]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11241 { label="Project"; 5028 [labelType="html" label="MapPartitionsRDD [5028]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11240 { label="DeserializeToObject"; 5029 [labelType="html" label="MapPartitionsRDD [5029]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11239 { label="MapPartitions"; 5030 [labelType="html" label="MapPartitionsRDD [5030]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster11249 { label="mapPartitions"; 5032 [labelType="html" label="MapPartitionsRDD [5032]<br>toJavaRDD at <unknown>:0"]; } } 5019->5020; 5020->5021; 5021->5022; 5022->5023; 5023->5024; 5024->5025; 5025->5026; 5026->5027; 5027->5028; 5028->5029; 5029->5030; 5030->5031; 5031->5032; 5032->5033; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time