3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1113 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 436
Associated Job Ids:
1114
DAG Visualization
digraph G { subgraph clusterstage_1113 { label="Stage 1113"; 11702 [labelType="html" label="SQLExecutionRDD [11702]<br>run at <unknown>:0"]; 11710 [labelType="html" label="SQLExecutionRDD [11710]<br>toJavaRDD at <unknown>:0"]; 11718 [labelType="html" label="PythonRDD [11718]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26180 { label="MicroBatchScan"; 11698 [labelType="html" label="DataSourceRDD [11698]<br>run at <unknown>:0"]; 11699 [labelType="html" label="MapPartitionsRDD [11699]<br>run at <unknown>:0"]; } subgraph cluster26179 { label="Project"; 11700 [labelType="html" label="MapPartitionsRDD [11700]<br>run at <unknown>:0"]; } subgraph cluster26175 { label="WholeStageCodegen (1)"; 11701 [labelType="html" label="MapPartitionsRDD [11701]<br>run at <unknown>:0"]; } subgraph cluster26189 { label="WholeStageCodegen (1)"; 11703 [labelType="html" label="MapPartitionsRDD [11703]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26188 { label="Filter"; 11704 [labelType="html" label="MapPartitionsRDD [11704]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26187 { label="Project"; 11705 [labelType="html" label="MapPartitionsRDD [11705]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26184 { label="WholeStageCodegen (2)"; 11706 [labelType="html" label="MapPartitionsRDD [11706]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26183 { label="Project"; 11707 [labelType="html" label="MapPartitionsRDD [11707]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26182 { label="DeserializeToObject"; 11708 [labelType="html" label="MapPartitionsRDD [11708]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26181 { label="MapPartitions"; 11709 [labelType="html" label="MapPartitionsRDD [11709]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26191 { label="mapPartitions"; 11711 [labelType="html" label="MapPartitionsRDD [11711]<br>toJavaRDD at <unknown>:0"]; } } 11698->11699; 11699->11700; 11700->11701; 11701->11702; 11702->11703; 11703->11704; 11704->11705; 11705->11706; 11706->11707; 11707->11708; 11708->11709; 11709->11710; 11710->11711; 11711->11718; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time