3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 632 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 487
Associated Job Ids:
632
DAG Visualization
digraph G { subgraph clusterstage_632 { label="Stage 632"; 6640 [labelType="html" label="SQLExecutionRDD [6640]<br>run at <unknown>:0"]; 6648 [labelType="html" label="SQLExecutionRDD [6648]<br>toJavaRDD at <unknown>:0"]; 6650 [labelType="html" label="PythonRDD [6650]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14857 { label="MicroBatchScan"; 6636 [labelType="html" label="DataSourceRDD [6636]<br>run at <unknown>:0"]; 6637 [labelType="html" label="MapPartitionsRDD [6637]<br>run at <unknown>:0"]; } subgraph cluster14856 { label="Project"; 6638 [labelType="html" label="MapPartitionsRDD [6638]<br>run at <unknown>:0"]; } subgraph cluster14852 { label="WholeStageCodegen (1)"; 6639 [labelType="html" label="MapPartitionsRDD [6639]<br>run at <unknown>:0"]; } subgraph cluster14866 { label="WholeStageCodegen (1)"; 6641 [labelType="html" label="MapPartitionsRDD [6641]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14865 { label="Filter"; 6642 [labelType="html" label="MapPartitionsRDD [6642]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14864 { label="Project"; 6643 [labelType="html" label="MapPartitionsRDD [6643]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14861 { label="WholeStageCodegen (2)"; 6644 [labelType="html" label="MapPartitionsRDD [6644]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14860 { label="Project"; 6645 [labelType="html" label="MapPartitionsRDD [6645]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14859 { label="DeserializeToObject"; 6646 [labelType="html" label="MapPartitionsRDD [6646]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14858 { label="MapPartitions"; 6647 [labelType="html" label="MapPartitionsRDD [6647]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14868 { label="mapPartitions"; 6649 [labelType="html" label="MapPartitionsRDD [6649]<br>toJavaRDD at <unknown>:0"]; } } 6636->6637; 6637->6638; 6638->6639; 6639->6640; 6640->6641; 6641->6642; 6642->6643; 6643->6644; 6644->6645; 6645->6646; 6646->6647; 6647->6648; 6648->6649; 6649->6650; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time