3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 388 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 438
Associated Job Ids:
388
DAG Visualization
digraph G { subgraph clusterstage_388 { label="Stage 388"; 4078 [labelType="html" label="SQLExecutionRDD [4078]<br>run at <unknown>:0"]; 4086 [labelType="html" label="SQLExecutionRDD [4086]<br>toJavaRDD at <unknown>:0"]; 4088 [labelType="html" label="PythonRDD [4088]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9123 { label="MicroBatchScan"; 4074 [labelType="html" label="DataSourceRDD [4074]<br>run at <unknown>:0"]; 4075 [labelType="html" label="MapPartitionsRDD [4075]<br>run at <unknown>:0"]; } subgraph cluster9122 { label="Project"; 4076 [labelType="html" label="MapPartitionsRDD [4076]<br>run at <unknown>:0"]; } subgraph cluster9118 { label="WholeStageCodegen (1)"; 4077 [labelType="html" label="MapPartitionsRDD [4077]<br>run at <unknown>:0"]; } subgraph cluster9132 { label="WholeStageCodegen (1)"; 4079 [labelType="html" label="MapPartitionsRDD [4079]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9131 { label="Filter"; 4080 [labelType="html" label="MapPartitionsRDD [4080]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9130 { label="Project"; 4081 [labelType="html" label="MapPartitionsRDD [4081]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9127 { label="WholeStageCodegen (2)"; 4082 [labelType="html" label="MapPartitionsRDD [4082]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9126 { label="Project"; 4083 [labelType="html" label="MapPartitionsRDD [4083]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9125 { label="DeserializeToObject"; 4084 [labelType="html" label="MapPartitionsRDD [4084]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9124 { label="MapPartitions"; 4085 [labelType="html" label="MapPartitionsRDD [4085]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9134 { label="mapPartitions"; 4087 [labelType="html" label="MapPartitionsRDD [4087]<br>toJavaRDD at <unknown>:0"]; } } 4074->4075; 4075->4076; 4076->4077; 4077->4078; 4078->4079; 4079->4080; 4080->4081; 4081->4082; 4082->4083; 4083->4084; 4084->4085; 4085->4086; 4086->4087; 4087->4088; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time