3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 296 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 460
Associated Job Ids:
296
DAG Visualization
digraph G { subgraph clusterstage_296 { label="Stage 296"; 3112 [labelType="html" label="SQLExecutionRDD [3112]<br>run at <unknown>:0"]; 3120 [labelType="html" label="SQLExecutionRDD [3120]<br>toJavaRDD at <unknown>:0"]; 3122 [labelType="html" label="PythonRDD [3122]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6961 { label="MicroBatchScan"; 3108 [labelType="html" label="DataSourceRDD [3108]<br>run at <unknown>:0"]; 3109 [labelType="html" label="MapPartitionsRDD [3109]<br>run at <unknown>:0"]; } subgraph cluster6960 { label="Project"; 3110 [labelType="html" label="MapPartitionsRDD [3110]<br>run at <unknown>:0"]; } subgraph cluster6956 { label="WholeStageCodegen (1)"; 3111 [labelType="html" label="MapPartitionsRDD [3111]<br>run at <unknown>:0"]; } subgraph cluster6970 { label="WholeStageCodegen (1)"; 3113 [labelType="html" label="MapPartitionsRDD [3113]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6969 { label="Filter"; 3114 [labelType="html" label="MapPartitionsRDD [3114]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6968 { label="Project"; 3115 [labelType="html" label="MapPartitionsRDD [3115]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6965 { label="WholeStageCodegen (2)"; 3116 [labelType="html" label="MapPartitionsRDD [3116]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6964 { label="Project"; 3117 [labelType="html" label="MapPartitionsRDD [3117]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6963 { label="DeserializeToObject"; 3118 [labelType="html" label="MapPartitionsRDD [3118]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6962 { label="MapPartitions"; 3119 [labelType="html" label="MapPartitionsRDD [3119]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6972 { label="mapPartitions"; 3121 [labelType="html" label="MapPartitionsRDD [3121]<br>toJavaRDD at <unknown>:0"]; } } 3108->3109; 3109->3110; 3110->3111; 3111->3112; 3112->3113; 3113->3114; 3114->3115; 3115->3116; 3116->3117; 3117->3118; 3118->3119; 3119->3120; 3120->3121; 3121->3122; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time