3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 804 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 397
Associated Job Ids:
804
DAG Visualization
digraph G { subgraph clusterstage_804 { label="Stage 804"; 8446 [labelType="html" label="SQLExecutionRDD [8446]<br>run at <unknown>:0"]; 8454 [labelType="html" label="SQLExecutionRDD [8454]<br>toJavaRDD at <unknown>:0"]; 8456 [labelType="html" label="PythonRDD [8456]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster18899 { label="MicroBatchScan"; 8442 [labelType="html" label="DataSourceRDD [8442]<br>run at <unknown>:0"]; 8443 [labelType="html" label="MapPartitionsRDD [8443]<br>run at <unknown>:0"]; } subgraph cluster18898 { label="Project"; 8444 [labelType="html" label="MapPartitionsRDD [8444]<br>run at <unknown>:0"]; } subgraph cluster18894 { label="WholeStageCodegen (1)"; 8445 [labelType="html" label="MapPartitionsRDD [8445]<br>run at <unknown>:0"]; } subgraph cluster18908 { label="WholeStageCodegen (1)"; 8447 [labelType="html" label="MapPartitionsRDD [8447]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18907 { label="Filter"; 8448 [labelType="html" label="MapPartitionsRDD [8448]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18906 { label="Project"; 8449 [labelType="html" label="MapPartitionsRDD [8449]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18903 { label="WholeStageCodegen (2)"; 8450 [labelType="html" label="MapPartitionsRDD [8450]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18902 { label="Project"; 8451 [labelType="html" label="MapPartitionsRDD [8451]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18901 { label="DeserializeToObject"; 8452 [labelType="html" label="MapPartitionsRDD [8452]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18900 { label="MapPartitions"; 8453 [labelType="html" label="MapPartitionsRDD [8453]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18910 { label="mapPartitions"; 8455 [labelType="html" label="MapPartitionsRDD [8455]<br>toJavaRDD at <unknown>:0"]; } } 8442->8443; 8443->8444; 8444->8445; 8445->8446; 8446->8447; 8447->8448; 8448->8449; 8449->8450; 8450->8451; 8451->8452; 8452->8453; 8453->8454; 8454->8455; 8455->8456; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time