3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1125 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 466
Associated Job Ids:
1126
DAG Visualization
digraph G { subgraph clusterstage_1125 { label="Stage 1125"; 11828 [labelType="html" label="SQLExecutionRDD [11828]<br>run at <unknown>:0"]; 11836 [labelType="html" label="SQLExecutionRDD [11836]<br>toJavaRDD at <unknown>:0"]; 11838 [labelType="html" label="PythonRDD [11838]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26462 { label="MicroBatchScan"; 11824 [labelType="html" label="DataSourceRDD [11824]<br>run at <unknown>:0"]; 11825 [labelType="html" label="MapPartitionsRDD [11825]<br>run at <unknown>:0"]; } subgraph cluster26461 { label="Project"; 11826 [labelType="html" label="MapPartitionsRDD [11826]<br>run at <unknown>:0"]; } subgraph cluster26457 { label="WholeStageCodegen (1)"; 11827 [labelType="html" label="MapPartitionsRDD [11827]<br>run at <unknown>:0"]; } subgraph cluster26471 { label="WholeStageCodegen (1)"; 11829 [labelType="html" label="MapPartitionsRDD [11829]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26470 { label="Filter"; 11830 [labelType="html" label="MapPartitionsRDD [11830]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26469 { label="Project"; 11831 [labelType="html" label="MapPartitionsRDD [11831]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26466 { label="WholeStageCodegen (2)"; 11832 [labelType="html" label="MapPartitionsRDD [11832]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26465 { label="Project"; 11833 [labelType="html" label="MapPartitionsRDD [11833]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26464 { label="DeserializeToObject"; 11834 [labelType="html" label="MapPartitionsRDD [11834]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26463 { label="MapPartitions"; 11835 [labelType="html" label="MapPartitionsRDD [11835]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26473 { label="mapPartitions"; 11837 [labelType="html" label="MapPartitionsRDD [11837]<br>toJavaRDD at <unknown>:0"]; } } 11824->11825; 11825->11826; 11826->11827; 11827->11828; 11828->11829; 11829->11830; 11830->11831; 11831->11832; 11832->11833; 11833->11834; 11834->11835; 11835->11836; 11836->11837; 11837->11838; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time