3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 295 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 403
Associated Job Ids:
295
DAG Visualization
digraph G { subgraph clusterstage_295 { label="Stage 295"; 3097 [labelType="html" label="SQLExecutionRDD [3097]<br>run at <unknown>:0"]; 3105 [labelType="html" label="SQLExecutionRDD [3105]<br>toJavaRDD at <unknown>:0"]; 3107 [labelType="html" label="PythonRDD [3107]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6922 { label="MicroBatchScan"; 3093 [labelType="html" label="DataSourceRDD [3093]<br>run at <unknown>:0"]; 3094 [labelType="html" label="MapPartitionsRDD [3094]<br>run at <unknown>:0"]; } subgraph cluster6921 { label="Project"; 3095 [labelType="html" label="MapPartitionsRDD [3095]<br>run at <unknown>:0"]; } subgraph cluster6917 { label="WholeStageCodegen (1)"; 3096 [labelType="html" label="MapPartitionsRDD [3096]<br>run at <unknown>:0"]; } subgraph cluster6931 { label="WholeStageCodegen (1)"; 3098 [labelType="html" label="MapPartitionsRDD [3098]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6930 { label="Filter"; 3099 [labelType="html" label="MapPartitionsRDD [3099]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6929 { label="Project"; 3100 [labelType="html" label="MapPartitionsRDD [3100]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6926 { label="WholeStageCodegen (2)"; 3101 [labelType="html" label="MapPartitionsRDD [3101]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6925 { label="Project"; 3102 [labelType="html" label="MapPartitionsRDD [3102]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6924 { label="DeserializeToObject"; 3103 [labelType="html" label="MapPartitionsRDD [3103]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6923 { label="MapPartitions"; 3104 [labelType="html" label="MapPartitionsRDD [3104]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6933 { label="mapPartitions"; 3106 [labelType="html" label="MapPartitionsRDD [3106]<br>toJavaRDD at <unknown>:0"]; } } 3093->3094; 3094->3095; 3095->3096; 3096->3097; 3097->3098; 3098->3099; 3099->3100; 3100->3101; 3101->3102; 3102->3103; 3103->3104; 3104->3105; 3105->3106; 3106->3107; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time