3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1411 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 453
Associated Job Ids:
1412
DAG Visualization
digraph G { subgraph clusterstage_1411 { label="Stage 1411"; 14831 [labelType="html" label="SQLExecutionRDD [14831]<br>run at <unknown>:0"]; 14839 [labelType="html" label="SQLExecutionRDD [14839]<br>toJavaRDD at <unknown>:0"]; 14841 [labelType="html" label="PythonRDD [14841]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster33183 { label="MicroBatchScan"; 14827 [labelType="html" label="DataSourceRDD [14827]<br>run at <unknown>:0"]; 14828 [labelType="html" label="MapPartitionsRDD [14828]<br>run at <unknown>:0"]; } subgraph cluster33182 { label="Project"; 14829 [labelType="html" label="MapPartitionsRDD [14829]<br>run at <unknown>:0"]; } subgraph cluster33178 { label="WholeStageCodegen (1)"; 14830 [labelType="html" label="MapPartitionsRDD [14830]<br>run at <unknown>:0"]; } subgraph cluster33192 { label="WholeStageCodegen (1)"; 14832 [labelType="html" label="MapPartitionsRDD [14832]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33191 { label="Filter"; 14833 [labelType="html" label="MapPartitionsRDD [14833]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33190 { label="Project"; 14834 [labelType="html" label="MapPartitionsRDD [14834]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33187 { label="WholeStageCodegen (2)"; 14835 [labelType="html" label="MapPartitionsRDD [14835]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33186 { label="Project"; 14836 [labelType="html" label="MapPartitionsRDD [14836]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33185 { label="DeserializeToObject"; 14837 [labelType="html" label="MapPartitionsRDD [14837]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33184 { label="MapPartitions"; 14838 [labelType="html" label="MapPartitionsRDD [14838]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33194 { label="mapPartitions"; 14840 [labelType="html" label="MapPartitionsRDD [14840]<br>toJavaRDD at <unknown>:0"]; } } 14827->14828; 14828->14829; 14829->14830; 14830->14831; 14831->14832; 14832->14833; 14833->14834; 14834->14835; 14835->14836; 14836->14837; 14837->14838; 14838->14839; 14839->14840; 14840->14841; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time