3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 27 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 422
Associated Job Ids:
27
DAG Visualization
digraph G { subgraph clusterstage_27 { label="Stage 27"; 283 [labelType="html" label="SQLExecutionRDD [283]<br>run at <unknown>:0"]; 291 [labelType="html" label="SQLExecutionRDD [291]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; 293 [labelType="html" label="PythonRDD [293]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster624 { label="MicroBatchScan"; 279 [labelType="html" label="DataSourceRDD [279]<br>run at <unknown>:0"]; 280 [labelType="html" label="MapPartitionsRDD [280]<br>run at <unknown>:0"]; } subgraph cluster623 { label="Project"; 281 [labelType="html" label="MapPartitionsRDD [281]<br>run at <unknown>:0"]; } subgraph cluster619 { label="WholeStageCodegen (1)"; 282 [labelType="html" label="MapPartitionsRDD [282]<br>run at <unknown>:0"]; } subgraph cluster633 { label="WholeStageCodegen (1)"; 284 [labelType="html" label="MapPartitionsRDD [284]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster632 { label="Filter"; 285 [labelType="html" label="MapPartitionsRDD [285]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster631 { label="Project"; 286 [labelType="html" label="MapPartitionsRDD [286]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster628 { label="WholeStageCodegen (2)"; 287 [labelType="html" label="MapPartitionsRDD [287]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster627 { label="Project"; 288 [labelType="html" label="MapPartitionsRDD [288]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster626 { label="DeserializeToObject"; 289 [labelType="html" label="MapPartitionsRDD [289]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster625 { label="MapPartitions"; 290 [labelType="html" label="MapPartitionsRDD [290]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } subgraph cluster635 { label="mapPartitions"; 292 [labelType="html" label="MapPartitionsRDD [292]<br>toJavaRDD at NativeMethodAccessorImpl.java:0"]; } } 279->280; 280->281; 281->282; 282->283; 283->284; 284->285; 285->286; 286->287; 287->288; 288->289; 289->290; 290->291; 291->292; 292->293; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time