3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 452 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 450
Associated Job Ids:
453
DAG Visualization
digraph G { subgraph clusterstage_452 { label="Stage 452"; 4751 [labelType="html" label="SQLExecutionRDD [4751]<br>run at <unknown>:0"]; 4765 [labelType="html" label="SQLExecutionRDD [4765]<br>toJavaRDD at <unknown>:0"]; 4767 [labelType="html" label="PythonRDD [4767]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10623 { label="MicroBatchScan"; 4747 [labelType="html" label="DataSourceRDD [4747]<br>run at <unknown>:0"]; 4748 [labelType="html" label="MapPartitionsRDD [4748]<br>run at <unknown>:0"]; } subgraph cluster10622 { label="Project"; 4749 [labelType="html" label="MapPartitionsRDD [4749]<br>run at <unknown>:0"]; } subgraph cluster10618 { label="WholeStageCodegen (1)"; 4750 [labelType="html" label="MapPartitionsRDD [4750]<br>run at <unknown>:0"]; } subgraph cluster10640 { label="WholeStageCodegen (1)"; 4758 [labelType="html" label="MapPartitionsRDD [4758]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10639 { label="Filter"; 4759 [labelType="html" label="MapPartitionsRDD [4759]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10638 { label="Project"; 4760 [labelType="html" label="MapPartitionsRDD [4760]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10635 { label="WholeStageCodegen (2)"; 4761 [labelType="html" label="MapPartitionsRDD [4761]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10634 { label="Project"; 4762 [labelType="html" label="MapPartitionsRDD [4762]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10633 { label="DeserializeToObject"; 4763 [labelType="html" label="MapPartitionsRDD [4763]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10632 { label="MapPartitions"; 4764 [labelType="html" label="MapPartitionsRDD [4764]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10642 { label="mapPartitions"; 4766 [labelType="html" label="MapPartitionsRDD [4766]<br>toJavaRDD at <unknown>:0"]; } } 4747->4748; 4748->4749; 4749->4750; 4750->4751; 4751->4758; 4758->4759; 4759->4760; 4760->4761; 4761->4762; 4762->4763; 4763->4764; 4764->4765; 4765->4766; 4766->4767; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time