3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 28 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 466
Associated Job Ids:
28
DAG Visualization
digraph G { subgraph clusterstage_28 { label="Stage 28"; 298 [labelType="html" label="SQLExecutionRDD [298]<br>run at <unknown>:0"]; 306 [labelType="html" label="SQLExecutionRDD [306]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; 308 [labelType="html" label="PythonRDD [308]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster663 { label="MicroBatchScan"; 294 [labelType="html" label="DataSourceRDD [294]<br>run at <unknown>:0"]; 295 [labelType="html" label="MapPartitionsRDD [295]<br>run at <unknown>:0"]; } subgraph cluster662 { label="Project"; 296 [labelType="html" label="MapPartitionsRDD [296]<br>run at <unknown>:0"]; } subgraph cluster658 { label="WholeStageCodegen (1)"; 297 [labelType="html" label="MapPartitionsRDD [297]<br>run at <unknown>:0"]; } subgraph cluster672 { label="WholeStageCodegen (1)"; 299 [labelType="html" label="MapPartitionsRDD [299]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster671 { label="Filter"; 300 [labelType="html" label="MapPartitionsRDD [300]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster670 { label="Project"; 301 [labelType="html" label="MapPartitionsRDD [301]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster667 { label="WholeStageCodegen (2)"; 302 [labelType="html" label="MapPartitionsRDD [302]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster666 { label="Project"; 303 [labelType="html" label="MapPartitionsRDD [303]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster665 { label="DeserializeToObject"; 304 [labelType="html" label="MapPartitionsRDD [304]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster664 { label="MapPartitions"; 305 [labelType="html" label="MapPartitionsRDD [305]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster674 { label="mapPartitions"; 307 [labelType="html" label="MapPartitionsRDD [307]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } } 294->295; 295->296; 296->297; 297->298; 298->299; 299->300; 300->301; 301->302; 302->303; 303->304; 304->305; 305->306; 306->307; 307->308; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time