3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 778 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 427
Associated Job Ids:
778
DAG Visualization
digraph G { subgraph clusterstage_778 { label="Stage 778"; 8173 [labelType="html" label="SQLExecutionRDD [8173]<br>run at <unknown>:0"]; 8181 [labelType="html" label="SQLExecutionRDD [8181]<br>toJavaRDD at <unknown>:0"]; 8183 [labelType="html" label="PythonRDD [8183]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster18288 { label="MicroBatchScan"; 8169 [labelType="html" label="DataSourceRDD [8169]<br>run at <unknown>:0"]; 8170 [labelType="html" label="MapPartitionsRDD [8170]<br>run at <unknown>:0"]; } subgraph cluster18287 { label="Project"; 8171 [labelType="html" label="MapPartitionsRDD [8171]<br>run at <unknown>:0"]; } subgraph cluster18283 { label="WholeStageCodegen (1)"; 8172 [labelType="html" label="MapPartitionsRDD [8172]<br>run at <unknown>:0"]; } subgraph cluster18297 { label="WholeStageCodegen (1)"; 8174 [labelType="html" label="MapPartitionsRDD [8174]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18296 { label="Filter"; 8175 [labelType="html" label="MapPartitionsRDD [8175]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18295 { label="Project"; 8176 [labelType="html" label="MapPartitionsRDD [8176]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18292 { label="WholeStageCodegen (2)"; 8177 [labelType="html" label="MapPartitionsRDD [8177]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18291 { label="Project"; 8178 [labelType="html" label="MapPartitionsRDD [8178]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18290 { label="DeserializeToObject"; 8179 [labelType="html" label="MapPartitionsRDD [8179]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18289 { label="MapPartitions"; 8180 [labelType="html" label="MapPartitionsRDD [8180]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18299 { label="mapPartitions"; 8182 [labelType="html" label="MapPartitionsRDD [8182]<br>toJavaRDD at <unknown>:0"]; } } 8169->8170; 8170->8171; 8171->8172; 8172->8173; 8173->8174; 8174->8175; 8175->8176; 8176->8177; 8177->8178; 8178->8179; 8179->8180; 8180->8181; 8181->8182; 8182->8183; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time