3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1352 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 501
Associated Job Ids:
1352
DAG Visualization
digraph G { subgraph clusterstage_1352 { label="Stage 1352"; 14200 [labelType="html" label="SQLExecutionRDD [14200]<br>run at <unknown>:0"]; 14208 [labelType="html" label="SQLExecutionRDD [14208]<br>toJavaRDD at <unknown>:0"]; 14210 [labelType="html" label="PythonRDD [14210]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster31777 { label="MicroBatchScan"; 14196 [labelType="html" label="DataSourceRDD [14196]<br>run at <unknown>:0"]; 14197 [labelType="html" label="MapPartitionsRDD [14197]<br>run at <unknown>:0"]; } subgraph cluster31776 { label="Project"; 14198 [labelType="html" label="MapPartitionsRDD [14198]<br>run at <unknown>:0"]; } subgraph cluster31772 { label="WholeStageCodegen (1)"; 14199 [labelType="html" label="MapPartitionsRDD [14199]<br>run at <unknown>:0"]; } subgraph cluster31786 { label="WholeStageCodegen (1)"; 14201 [labelType="html" label="MapPartitionsRDD [14201]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31785 { label="Filter"; 14202 [labelType="html" label="MapPartitionsRDD [14202]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31784 { label="Project"; 14203 [labelType="html" label="MapPartitionsRDD [14203]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31781 { label="WholeStageCodegen (2)"; 14204 [labelType="html" label="MapPartitionsRDD [14204]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31780 { label="Project"; 14205 [labelType="html" label="MapPartitionsRDD [14205]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31779 { label="DeserializeToObject"; 14206 [labelType="html" label="MapPartitionsRDD [14206]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31778 { label="MapPartitions"; 14207 [labelType="html" label="MapPartitionsRDD [14207]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster31788 { label="mapPartitions"; 14209 [labelType="html" label="MapPartitionsRDD [14209]<br>toJavaRDD at <unknown>:0"]; } } 14196->14197; 14197->14198; 14198->14199; 14199->14200; 14200->14201; 14201->14202; 14202->14203; 14203->14204; 14204->14205; 14205->14206; 14206->14207; 14207->14208; 14208->14209; 14209->14210; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time