3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1906 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 430
Associated Job Ids:
1906
DAG Visualization
digraph G { subgraph clusterstage_1906 { label="Stage 1906"; 20017 [labelType="html" label="SQLExecutionRDD [20017]<br>run at <unknown>:0"]; 20025 [labelType="html" label="SQLExecutionRDD [20025]<br>toJavaRDD at <unknown>:0"]; 20027 [labelType="html" label="PythonRDD [20027]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44796 { label="MicroBatchScan"; 20013 [labelType="html" label="DataSourceRDD [20013]<br>run at <unknown>:0"]; 20014 [labelType="html" label="MapPartitionsRDD [20014]<br>run at <unknown>:0"]; } subgraph cluster44795 { label="Project"; 20015 [labelType="html" label="MapPartitionsRDD [20015]<br>run at <unknown>:0"]; } subgraph cluster44791 { label="WholeStageCodegen (1)"; 20016 [labelType="html" label="MapPartitionsRDD [20016]<br>run at <unknown>:0"]; } subgraph cluster44805 { label="WholeStageCodegen (1)"; 20018 [labelType="html" label="MapPartitionsRDD [20018]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44804 { label="Filter"; 20019 [labelType="html" label="MapPartitionsRDD [20019]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44803 { label="Project"; 20020 [labelType="html" label="MapPartitionsRDD [20020]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44800 { label="WholeStageCodegen (2)"; 20021 [labelType="html" label="MapPartitionsRDD [20021]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44799 { label="Project"; 20022 [labelType="html" label="MapPartitionsRDD [20022]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44798 { label="DeserializeToObject"; 20023 [labelType="html" label="MapPartitionsRDD [20023]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44797 { label="MapPartitions"; 20024 [labelType="html" label="MapPartitionsRDD [20024]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44807 { label="mapPartitions"; 20026 [labelType="html" label="MapPartitionsRDD [20026]<br>toJavaRDD at <unknown>:0"]; } } 20013->20014; 20014->20015; 20015->20016; 20016->20017; 20017->20018; 20018->20019; 20019->20020; 20020->20021; 20021->20022; 20022->20023; 20023->20024; 20024->20025; 20025->20026; 20026->20027; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time