3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 387 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 489
Associated Job Ids:
387
DAG Visualization
digraph G { subgraph clusterstage_387 { label="Stage 387"; 4057 [labelType="html" label="SQLExecutionRDD [4057]<br>run at <unknown>:0"]; 4071 [labelType="html" label="SQLExecutionRDD [4071]<br>toJavaRDD at <unknown>:0"]; 4073 [labelType="html" label="PythonRDD [4073]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9076 { label="MicroBatchScan"; 4053 [labelType="html" label="DataSourceRDD [4053]<br>run at <unknown>:0"]; 4054 [labelType="html" label="MapPartitionsRDD [4054]<br>run at <unknown>:0"]; } subgraph cluster9075 { label="Project"; 4055 [labelType="html" label="MapPartitionsRDD [4055]<br>run at <unknown>:0"]; } subgraph cluster9071 { label="WholeStageCodegen (1)"; 4056 [labelType="html" label="MapPartitionsRDD [4056]<br>run at <unknown>:0"]; } subgraph cluster9093 { label="WholeStageCodegen (1)"; 4064 [labelType="html" label="MapPartitionsRDD [4064]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9092 { label="Filter"; 4065 [labelType="html" label="MapPartitionsRDD [4065]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9091 { label="Project"; 4066 [labelType="html" label="MapPartitionsRDD [4066]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9088 { label="WholeStageCodegen (2)"; 4067 [labelType="html" label="MapPartitionsRDD [4067]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9087 { label="Project"; 4068 [labelType="html" label="MapPartitionsRDD [4068]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9086 { label="DeserializeToObject"; 4069 [labelType="html" label="MapPartitionsRDD [4069]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9085 { label="MapPartitions"; 4070 [labelType="html" label="MapPartitionsRDD [4070]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9095 { label="mapPartitions"; 4072 [labelType="html" label="MapPartitionsRDD [4072]<br>toJavaRDD at <unknown>:0"]; } } 4053->4054; 4054->4055; 4055->4056; 4056->4057; 4057->4064; 4064->4065; 4065->4066; 4066->4067; 4067->4068; 4068->4069; 4069->4070; 4070->4071; 4071->4072; 4072->4073; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time