3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 172 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 435
Associated Job Ids:
172
DAG Visualization
digraph G { subgraph clusterstage_172 { label="Stage 172"; 1810 [labelType="html" label="SQLExecutionRDD [1810]<br>run at <unknown>:0"]; 1818 [labelType="html" label="SQLExecutionRDD [1818]<br>toJavaRDD at <unknown>:0"]; 1820 [labelType="html" label="PythonRDD [1820]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4047 { label="MicroBatchScan"; 1806 [labelType="html" label="DataSourceRDD [1806]<br>run at <unknown>:0"]; 1807 [labelType="html" label="MapPartitionsRDD [1807]<br>run at <unknown>:0"]; } subgraph cluster4046 { label="Project"; 1808 [labelType="html" label="MapPartitionsRDD [1808]<br>run at <unknown>:0"]; } subgraph cluster4042 { label="WholeStageCodegen (1)"; 1809 [labelType="html" label="MapPartitionsRDD [1809]<br>run at <unknown>:0"]; } subgraph cluster4056 { label="WholeStageCodegen (1)"; 1811 [labelType="html" label="MapPartitionsRDD [1811]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4055 { label="Filter"; 1812 [labelType="html" label="MapPartitionsRDD [1812]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4054 { label="Project"; 1813 [labelType="html" label="MapPartitionsRDD [1813]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4051 { label="WholeStageCodegen (2)"; 1814 [labelType="html" label="MapPartitionsRDD [1814]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4050 { label="Project"; 1815 [labelType="html" label="MapPartitionsRDD [1815]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4049 { label="DeserializeToObject"; 1816 [labelType="html" label="MapPartitionsRDD [1816]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4048 { label="MapPartitions"; 1817 [labelType="html" label="MapPartitionsRDD [1817]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4058 { label="mapPartitions"; 1819 [labelType="html" label="MapPartitionsRDD [1819]<br>toJavaRDD at <unknown>:0"]; } } 1806->1807; 1807->1808; 1808->1809; 1809->1810; 1810->1811; 1811->1812; 1812->1813; 1813->1814; 1814->1815; 1815->1816; 1816->1817; 1817->1818; 1818->1819; 1819->1820; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time