3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1063 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 473
Associated Job Ids:
1064
DAG Visualization
digraph G { subgraph clusterstage_1063 { label="Stage 1063"; 11177 [labelType="html" label="SQLExecutionRDD [11177]<br>run at <unknown>:0"]; 11185 [labelType="html" label="SQLExecutionRDD [11185]<br>toJavaRDD at <unknown>:0"]; 11187 [labelType="html" label="PythonRDD [11187]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster25005 { label="MicroBatchScan"; 11173 [labelType="html" label="DataSourceRDD [11173]<br>run at <unknown>:0"]; 11174 [labelType="html" label="MapPartitionsRDD [11174]<br>run at <unknown>:0"]; } subgraph cluster25004 { label="Project"; 11175 [labelType="html" label="MapPartitionsRDD [11175]<br>run at <unknown>:0"]; } subgraph cluster25000 { label="WholeStageCodegen (1)"; 11176 [labelType="html" label="MapPartitionsRDD [11176]<br>run at <unknown>:0"]; } subgraph cluster25014 { label="WholeStageCodegen (1)"; 11178 [labelType="html" label="MapPartitionsRDD [11178]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25013 { label="Filter"; 11179 [labelType="html" label="MapPartitionsRDD [11179]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25012 { label="Project"; 11180 [labelType="html" label="MapPartitionsRDD [11180]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25009 { label="WholeStageCodegen (2)"; 11181 [labelType="html" label="MapPartitionsRDD [11181]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25008 { label="Project"; 11182 [labelType="html" label="MapPartitionsRDD [11182]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25007 { label="DeserializeToObject"; 11183 [labelType="html" label="MapPartitionsRDD [11183]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25006 { label="MapPartitions"; 11184 [labelType="html" label="MapPartitionsRDD [11184]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25016 { label="mapPartitions"; 11186 [labelType="html" label="MapPartitionsRDD [11186]<br>toJavaRDD at <unknown>:0"]; } } 11173->11174; 11174->11175; 11175->11176; 11176->11177; 11177->11178; 11178->11179; 11179->11180; 11180->11181; 11181->11182; 11182->11183; 11183->11184; 11184->11185; 11185->11186; 11186->11187; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time