3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1143 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 428
Associated Job Ids:
1144
DAG Visualization
digraph G { subgraph clusterstage_1143 { label="Stage 1143"; 12017 [labelType="html" label="SQLExecutionRDD [12017]<br>run at <unknown>:0"]; 12025 [labelType="html" label="SQLExecutionRDD [12025]<br>toJavaRDD at <unknown>:0"]; 12027 [labelType="html" label="PythonRDD [12027]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26885 { label="MicroBatchScan"; 12013 [labelType="html" label="DataSourceRDD [12013]<br>run at <unknown>:0"]; 12014 [labelType="html" label="MapPartitionsRDD [12014]<br>run at <unknown>:0"]; } subgraph cluster26884 { label="Project"; 12015 [labelType="html" label="MapPartitionsRDD [12015]<br>run at <unknown>:0"]; } subgraph cluster26880 { label="WholeStageCodegen (1)"; 12016 [labelType="html" label="MapPartitionsRDD [12016]<br>run at <unknown>:0"]; } subgraph cluster26894 { label="WholeStageCodegen (1)"; 12018 [labelType="html" label="MapPartitionsRDD [12018]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26893 { label="Filter"; 12019 [labelType="html" label="MapPartitionsRDD [12019]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26892 { label="Project"; 12020 [labelType="html" label="MapPartitionsRDD [12020]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26889 { label="WholeStageCodegen (2)"; 12021 [labelType="html" label="MapPartitionsRDD [12021]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26888 { label="Project"; 12022 [labelType="html" label="MapPartitionsRDD [12022]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26887 { label="DeserializeToObject"; 12023 [labelType="html" label="MapPartitionsRDD [12023]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26886 { label="MapPartitions"; 12024 [labelType="html" label="MapPartitionsRDD [12024]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26896 { label="mapPartitions"; 12026 [labelType="html" label="MapPartitionsRDD [12026]<br>toJavaRDD at <unknown>:0"]; } } 12013->12014; 12014->12015; 12015->12016; 12016->12017; 12017->12018; 12018->12019; 12019->12020; 12020->12021; 12021->12022; 12022->12023; 12023->12024; 12024->12025; 12025->12026; 12026->12027; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time