3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 161 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 438
Associated Job Ids:
161
DAG Visualization
digraph G { subgraph clusterstage_161 { label="Stage 161"; 1690 [labelType="html" label="SQLExecutionRDD [1690]<br>run at <unknown>:0"]; 1698 [labelType="html" label="SQLExecutionRDD [1698]<br>toJavaRDD at <unknown>:0"]; 1700 [labelType="html" label="PythonRDD [1700]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster3773 { label="MicroBatchScan"; 1686 [labelType="html" label="DataSourceRDD [1686]<br>run at <unknown>:0"]; 1687 [labelType="html" label="MapPartitionsRDD [1687]<br>run at <unknown>:0"]; } subgraph cluster3772 { label="Project"; 1688 [labelType="html" label="MapPartitionsRDD [1688]<br>run at <unknown>:0"]; } subgraph cluster3768 { label="WholeStageCodegen (1)"; 1689 [labelType="html" label="MapPartitionsRDD [1689]<br>run at <unknown>:0"]; } subgraph cluster3782 { label="WholeStageCodegen (1)"; 1691 [labelType="html" label="MapPartitionsRDD [1691]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3781 { label="Filter"; 1692 [labelType="html" label="MapPartitionsRDD [1692]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3780 { label="Project"; 1693 [labelType="html" label="MapPartitionsRDD [1693]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3777 { label="WholeStageCodegen (2)"; 1694 [labelType="html" label="MapPartitionsRDD [1694]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3776 { label="Project"; 1695 [labelType="html" label="MapPartitionsRDD [1695]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3775 { label="DeserializeToObject"; 1696 [labelType="html" label="MapPartitionsRDD [1696]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3774 { label="MapPartitions"; 1697 [labelType="html" label="MapPartitionsRDD [1697]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3784 { label="mapPartitions"; 1699 [labelType="html" label="MapPartitionsRDD [1699]<br>toJavaRDD at <unknown>:0"]; } } 1686->1687; 1687->1688; 1688->1689; 1689->1690; 1690->1691; 1691->1692; 1692->1693; 1693->1694; 1694->1695; 1695->1696; 1696->1697; 1697->1698; 1698->1699; 1699->1700; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time