3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 822 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 576
Associated Job Ids:
822
DAG Visualization
digraph G { subgraph clusterstage_822 { label="Stage 822"; 8635 [labelType="html" label="SQLExecutionRDD [8635]<br>run at <unknown>:0"]; 8643 [labelType="html" label="SQLExecutionRDD [8643]<br>toJavaRDD at <unknown>:0"]; 8645 [labelType="html" label="PythonRDD [8645]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19322 { label="MicroBatchScan"; 8631 [labelType="html" label="DataSourceRDD [8631]<br>run at <unknown>:0"]; 8632 [labelType="html" label="MapPartitionsRDD [8632]<br>run at <unknown>:0"]; } subgraph cluster19321 { label="Project"; 8633 [labelType="html" label="MapPartitionsRDD [8633]<br>run at <unknown>:0"]; } subgraph cluster19317 { label="WholeStageCodegen (1)"; 8634 [labelType="html" label="MapPartitionsRDD [8634]<br>run at <unknown>:0"]; } subgraph cluster19331 { label="WholeStageCodegen (1)"; 8636 [labelType="html" label="MapPartitionsRDD [8636]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19330 { label="Filter"; 8637 [labelType="html" label="MapPartitionsRDD [8637]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19329 { label="Project"; 8638 [labelType="html" label="MapPartitionsRDD [8638]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19326 { label="WholeStageCodegen (2)"; 8639 [labelType="html" label="MapPartitionsRDD [8639]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19325 { label="Project"; 8640 [labelType="html" label="MapPartitionsRDD [8640]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19324 { label="DeserializeToObject"; 8641 [labelType="html" label="MapPartitionsRDD [8641]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19323 { label="MapPartitions"; 8642 [labelType="html" label="MapPartitionsRDD [8642]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19333 { label="mapPartitions"; 8644 [labelType="html" label="MapPartitionsRDD [8644]<br>toJavaRDD at <unknown>:0"]; } } 8631->8632; 8632->8633; 8633->8634; 8634->8635; 8635->8636; 8636->8637; 8637->8638; 8638->8639; 8639->8640; 8640->8641; 8641->8642; 8642->8643; 8643->8644; 8644->8645; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time