3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 333 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 522
Associated Job Ids:
333
DAG Visualization
digraph G { subgraph clusterstage_333 { label="Stage 333"; 3490 [labelType="html" label="SQLExecutionRDD [3490]<br>run at <unknown>:0"]; 3504 [labelType="html" label="SQLExecutionRDD [3504]<br>toJavaRDD at <unknown>:0"]; 3506 [labelType="html" label="PythonRDD [3506]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7807 { label="MicroBatchScan"; 3486 [labelType="html" label="DataSourceRDD [3486]<br>run at <unknown>:0"]; 3487 [labelType="html" label="MapPartitionsRDD [3487]<br>run at <unknown>:0"]; } subgraph cluster7806 { label="Project"; 3488 [labelType="html" label="MapPartitionsRDD [3488]<br>run at <unknown>:0"]; } subgraph cluster7802 { label="WholeStageCodegen (1)"; 3489 [labelType="html" label="MapPartitionsRDD [3489]<br>run at <unknown>:0"]; } subgraph cluster7824 { label="WholeStageCodegen (1)"; 3497 [labelType="html" label="MapPartitionsRDD [3497]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7823 { label="Filter"; 3498 [labelType="html" label="MapPartitionsRDD [3498]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7822 { label="Project"; 3499 [labelType="html" label="MapPartitionsRDD [3499]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7819 { label="WholeStageCodegen (2)"; 3500 [labelType="html" label="MapPartitionsRDD [3500]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7818 { label="Project"; 3501 [labelType="html" label="MapPartitionsRDD [3501]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7817 { label="DeserializeToObject"; 3502 [labelType="html" label="MapPartitionsRDD [3502]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7816 { label="MapPartitions"; 3503 [labelType="html" label="MapPartitionsRDD [3503]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7826 { label="mapPartitions"; 3505 [labelType="html" label="MapPartitionsRDD [3505]<br>toJavaRDD at <unknown>:0"]; } } 3486->3487; 3487->3488; 3488->3489; 3489->3490; 3490->3497; 3497->3498; 3498->3499; 3499->3500; 3500->3501; 3501->3502; 3502->3503; 3503->3504; 3504->3505; 3505->3506; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time