3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1786 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 485
Associated Job Ids:
1786
DAG Visualization
digraph G { subgraph clusterstage_1786 { label="Stage 1786"; 18757 [labelType="html" label="SQLExecutionRDD [18757]<br>run at <unknown>:0"]; 18765 [labelType="html" label="SQLExecutionRDD [18765]<br>toJavaRDD at <unknown>:0"]; 18767 [labelType="html" label="PythonRDD [18767]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster41976 { label="MicroBatchScan"; 18753 [labelType="html" label="DataSourceRDD [18753]<br>run at <unknown>:0"]; 18754 [labelType="html" label="MapPartitionsRDD [18754]<br>run at <unknown>:0"]; } subgraph cluster41975 { label="Project"; 18755 [labelType="html" label="MapPartitionsRDD [18755]<br>run at <unknown>:0"]; } subgraph cluster41971 { label="WholeStageCodegen (1)"; 18756 [labelType="html" label="MapPartitionsRDD [18756]<br>run at <unknown>:0"]; } subgraph cluster41985 { label="WholeStageCodegen (1)"; 18758 [labelType="html" label="MapPartitionsRDD [18758]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41984 { label="Filter"; 18759 [labelType="html" label="MapPartitionsRDD [18759]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41983 { label="Project"; 18760 [labelType="html" label="MapPartitionsRDD [18760]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41980 { label="WholeStageCodegen (2)"; 18761 [labelType="html" label="MapPartitionsRDD [18761]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41979 { label="Project"; 18762 [labelType="html" label="MapPartitionsRDD [18762]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41978 { label="DeserializeToObject"; 18763 [labelType="html" label="MapPartitionsRDD [18763]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41977 { label="MapPartitions"; 18764 [labelType="html" label="MapPartitionsRDD [18764]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster41987 { label="mapPartitions"; 18766 [labelType="html" label="MapPartitionsRDD [18766]<br>toJavaRDD at <unknown>:0"]; } } 18753->18754; 18754->18755; 18755->18756; 18756->18757; 18757->18758; 18758->18759; 18759->18760; 18760->18761; 18761->18762; 18762->18763; 18763->18764; 18764->18765; 18765->18766; 18766->18767; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time