3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1445 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 415
Associated Job Ids:
1446
DAG Visualization
digraph G { subgraph clusterstage_1445 { label="Stage 1445"; 15188 [labelType="html" label="SQLExecutionRDD [15188]<br>run at <unknown>:0"]; 15196 [labelType="html" label="SQLExecutionRDD [15196]<br>toJavaRDD at <unknown>:0"]; 15198 [labelType="html" label="PythonRDD [15198]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster33982 { label="MicroBatchScan"; 15184 [labelType="html" label="DataSourceRDD [15184]<br>run at <unknown>:0"]; 15185 [labelType="html" label="MapPartitionsRDD [15185]<br>run at <unknown>:0"]; } subgraph cluster33981 { label="Project"; 15186 [labelType="html" label="MapPartitionsRDD [15186]<br>run at <unknown>:0"]; } subgraph cluster33977 { label="WholeStageCodegen (1)"; 15187 [labelType="html" label="MapPartitionsRDD [15187]<br>run at <unknown>:0"]; } subgraph cluster33991 { label="WholeStageCodegen (1)"; 15189 [labelType="html" label="MapPartitionsRDD [15189]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33990 { label="Filter"; 15190 [labelType="html" label="MapPartitionsRDD [15190]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33989 { label="Project"; 15191 [labelType="html" label="MapPartitionsRDD [15191]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33986 { label="WholeStageCodegen (2)"; 15192 [labelType="html" label="MapPartitionsRDD [15192]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33985 { label="Project"; 15193 [labelType="html" label="MapPartitionsRDD [15193]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33984 { label="DeserializeToObject"; 15194 [labelType="html" label="MapPartitionsRDD [15194]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33983 { label="MapPartitions"; 15195 [labelType="html" label="MapPartitionsRDD [15195]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33993 { label="mapPartitions"; 15197 [labelType="html" label="MapPartitionsRDD [15197]<br>toJavaRDD at <unknown>:0"]; } } 15184->15185; 15185->15186; 15186->15187; 15187->15188; 15188->15189; 15189->15190; 15190->15191; 15191->15192; 15192->15193; 15193->15194; 15194->15195; 15195->15196; 15196->15197; 15197->15198; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time