3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1549 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 321
Associated Job Ids:
1549
DAG Visualization
digraph G { subgraph clusterstage_1549 { label="Stage 1549"; 16264 [labelType="html" label="SQLExecutionRDD [16264]<br>run at <unknown>:0"]; 16272 [labelType="html" label="SQLExecutionRDD [16272]<br>toJavaRDD at <unknown>:0"]; 16274 [labelType="html" label="PythonRDD [16274]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster36391 { label="MicroBatchScan"; 16260 [labelType="html" label="DataSourceRDD [16260]<br>run at <unknown>:0"]; 16261 [labelType="html" label="MapPartitionsRDD [16261]<br>run at <unknown>:0"]; } subgraph cluster36390 { label="Project"; 16262 [labelType="html" label="MapPartitionsRDD [16262]<br>run at <unknown>:0"]; } subgraph cluster36386 { label="WholeStageCodegen (1)"; 16263 [labelType="html" label="MapPartitionsRDD [16263]<br>run at <unknown>:0"]; } subgraph cluster36400 { label="WholeStageCodegen (1)"; 16265 [labelType="html" label="MapPartitionsRDD [16265]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36399 { label="Filter"; 16266 [labelType="html" label="MapPartitionsRDD [16266]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36398 { label="Project"; 16267 [labelType="html" label="MapPartitionsRDD [16267]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36395 { label="WholeStageCodegen (2)"; 16268 [labelType="html" label="MapPartitionsRDD [16268]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36394 { label="Project"; 16269 [labelType="html" label="MapPartitionsRDD [16269]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36393 { label="DeserializeToObject"; 16270 [labelType="html" label="MapPartitionsRDD [16270]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36392 { label="MapPartitions"; 16271 [labelType="html" label="MapPartitionsRDD [16271]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster36402 { label="mapPartitions"; 16273 [labelType="html" label="MapPartitionsRDD [16273]<br>toJavaRDD at <unknown>:0"]; } } 16260->16261; 16261->16262; 16262->16263; 16263->16264; 16264->16265; 16265->16266; 16266->16267; 16267->16268; 16268->16269; 16269->16270; 16270->16271; 16271->16272; 16272->16273; 16273->16274; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time