3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 865 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 345
Associated Job Ids:
865
DAG Visualization
digraph G { subgraph clusterstage_865 { label="Stage 865"; 9082 [labelType="html" label="SQLExecutionRDD [9082]<br>run at <unknown>:0"]; 9090 [labelType="html" label="SQLExecutionRDD [9090]<br>toJavaRDD at <unknown>:0"]; 9092 [labelType="html" label="PythonRDD [9092]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20317 { label="MicroBatchScan"; 9078 [labelType="html" label="DataSourceRDD [9078]<br>run at <unknown>:0"]; 9079 [labelType="html" label="MapPartitionsRDD [9079]<br>run at <unknown>:0"]; } subgraph cluster20316 { label="Project"; 9080 [labelType="html" label="MapPartitionsRDD [9080]<br>run at <unknown>:0"]; } subgraph cluster20312 { label="WholeStageCodegen (1)"; 9081 [labelType="html" label="MapPartitionsRDD [9081]<br>run at <unknown>:0"]; } subgraph cluster20326 { label="WholeStageCodegen (1)"; 9083 [labelType="html" label="MapPartitionsRDD [9083]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20325 { label="Filter"; 9084 [labelType="html" label="MapPartitionsRDD [9084]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20324 { label="Project"; 9085 [labelType="html" label="MapPartitionsRDD [9085]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20321 { label="WholeStageCodegen (2)"; 9086 [labelType="html" label="MapPartitionsRDD [9086]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20320 { label="Project"; 9087 [labelType="html" label="MapPartitionsRDD [9087]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20319 { label="DeserializeToObject"; 9088 [labelType="html" label="MapPartitionsRDD [9088]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20318 { label="MapPartitions"; 9089 [labelType="html" label="MapPartitionsRDD [9089]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20328 { label="mapPartitions"; 9091 [labelType="html" label="MapPartitionsRDD [9091]<br>toJavaRDD at <unknown>:0"]; } } 9078->9079; 9079->9080; 9080->9081; 9081->9082; 9082->9083; 9083->9084; 9084->9085; 9085->9086; 9086->9087; 9087->9088; 9088->9089; 9089->9090; 9090->9091; 9091->9092; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time