3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 766 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 435
Associated Job Ids:
766
DAG Visualization
digraph G { subgraph clusterstage_766 { label="Stage 766"; 8047 [labelType="html" label="SQLExecutionRDD [8047]<br>run at <unknown>:0"]; 8055 [labelType="html" label="SQLExecutionRDD [8055]<br>toJavaRDD at <unknown>:0"]; 8057 [labelType="html" label="PythonRDD [8057]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster18006 { label="MicroBatchScan"; 8043 [labelType="html" label="DataSourceRDD [8043]<br>run at <unknown>:0"]; 8044 [labelType="html" label="MapPartitionsRDD [8044]<br>run at <unknown>:0"]; } subgraph cluster18005 { label="Project"; 8045 [labelType="html" label="MapPartitionsRDD [8045]<br>run at <unknown>:0"]; } subgraph cluster18001 { label="WholeStageCodegen (1)"; 8046 [labelType="html" label="MapPartitionsRDD [8046]<br>run at <unknown>:0"]; } subgraph cluster18015 { label="WholeStageCodegen (1)"; 8048 [labelType="html" label="MapPartitionsRDD [8048]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18014 { label="Filter"; 8049 [labelType="html" label="MapPartitionsRDD [8049]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18013 { label="Project"; 8050 [labelType="html" label="MapPartitionsRDD [8050]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18010 { label="WholeStageCodegen (2)"; 8051 [labelType="html" label="MapPartitionsRDD [8051]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18009 { label="Project"; 8052 [labelType="html" label="MapPartitionsRDD [8052]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18008 { label="DeserializeToObject"; 8053 [labelType="html" label="MapPartitionsRDD [8053]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18007 { label="MapPartitions"; 8054 [labelType="html" label="MapPartitionsRDD [8054]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18017 { label="mapPartitions"; 8056 [labelType="html" label="MapPartitionsRDD [8056]<br>toJavaRDD at <unknown>:0"]; } } 8043->8044; 8044->8045; 8045->8046; 8046->8047; 8047->8048; 8048->8049; 8049->8050; 8050->8051; 8051->8052; 8052->8053; 8053->8054; 8054->8055; 8055->8056; 8056->8057; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time