3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 128 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 388
Associated Job Ids:
128
DAG Visualization
digraph G { subgraph clusterstage_128 { label="Stage 128"; 1348 [labelType="html" label="SQLExecutionRDD [1348]<br>run at <unknown>:0"]; 1356 [labelType="html" label="SQLExecutionRDD [1356]<br>toJavaRDD at <unknown>:0"]; 1364 [labelType="html" label="PythonRDD [1364]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster3013 { label="MicroBatchScan"; 1344 [labelType="html" label="DataSourceRDD [1344]<br>run at <unknown>:0"]; 1345 [labelType="html" label="MapPartitionsRDD [1345]<br>run at <unknown>:0"]; } subgraph cluster3012 { label="Project"; 1346 [labelType="html" label="MapPartitionsRDD [1346]<br>run at <unknown>:0"]; } subgraph cluster3008 { label="WholeStageCodegen (1)"; 1347 [labelType="html" label="MapPartitionsRDD [1347]<br>run at <unknown>:0"]; } subgraph cluster3022 { label="WholeStageCodegen (1)"; 1349 [labelType="html" label="MapPartitionsRDD [1349]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3021 { label="Filter"; 1350 [labelType="html" label="MapPartitionsRDD [1350]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3020 { label="Project"; 1351 [labelType="html" label="MapPartitionsRDD [1351]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3017 { label="WholeStageCodegen (2)"; 1352 [labelType="html" label="MapPartitionsRDD [1352]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3016 { label="Project"; 1353 [labelType="html" label="MapPartitionsRDD [1353]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3015 { label="DeserializeToObject"; 1354 [labelType="html" label="MapPartitionsRDD [1354]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3014 { label="MapPartitions"; 1355 [labelType="html" label="MapPartitionsRDD [1355]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3030 { label="mapPartitions"; 1357 [labelType="html" label="MapPartitionsRDD [1357]<br>toJavaRDD at <unknown>:0"]; } } 1344->1345; 1345->1346; 1346->1347; 1347->1348; 1348->1349; 1349->1350; 1350->1351; 1351->1352; 1352->1353; 1353->1354; 1354->1355; 1355->1356; 1356->1357; 1357->1364; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time