3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1350 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 454
Associated Job Ids:
1350
DAG Visualization
digraph G { subgraph clusterstage_1350 { label="Stage 1350"; 14179 [labelType="html" label="SQLExecutionRDD [14179]<br>run at <unknown>:0"]; 14187 [labelType="html" label="SQLExecutionRDD [14187]<br>toJavaRDD at <unknown>:0"]; 14189 [labelType="html" label="PythonRDD [14189]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster31730 { label="MicroBatchScan"; 14175 [labelType="html" label="DataSourceRDD [14175]<br>run at <unknown>:0"]; 14176 [labelType="html" label="MapPartitionsRDD [14176]<br>run at <unknown>:0"]; } subgraph cluster31729 { label="Project"; 14177 [labelType="html" label="MapPartitionsRDD [14177]<br>run at <unknown>:0"]; } subgraph cluster31725 { label="WholeStageCodegen (1)"; 14178 [labelType="html" label="MapPartitionsRDD [14178]<br>run at <unknown>:0"]; } subgraph cluster31739 { label="WholeStageCodegen (1)"; 14180 [labelType="html" label="MapPartitionsRDD [14180]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31738 { label="Filter"; 14181 [labelType="html" label="MapPartitionsRDD [14181]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31737 { label="Project"; 14182 [labelType="html" label="MapPartitionsRDD [14182]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31734 { label="WholeStageCodegen (2)"; 14183 [labelType="html" label="MapPartitionsRDD [14183]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31733 { label="Project"; 14184 [labelType="html" label="MapPartitionsRDD [14184]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31732 { label="DeserializeToObject"; 14185 [labelType="html" label="MapPartitionsRDD [14185]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31731 { label="MapPartitions"; 14186 [labelType="html" label="MapPartitionsRDD [14186]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31741 { label="mapPartitions"; 14188 [labelType="html" label="MapPartitionsRDD [14188]<br>toJavaRDD at <unknown>:0"]; } } 14175->14176; 14176->14177; 14177->14178; 14178->14179; 14179->14180; 14180->14181; 14181->14182; 14182->14183; 14183->14184; 14184->14185; 14185->14186; 14186->14187; 14187->14188; 14188->14189; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time