3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 447 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 346
Associated Job Ids:
448
DAG Visualization
digraph G { subgraph clusterstage_447 { label="Stage 447"; 4709 [labelType="html" label="SQLExecutionRDD [4709]<br>run at <unknown>:0"]; 4717 [labelType="html" label="SQLExecutionRDD [4717]<br>toJavaRDD at <unknown>:0"]; 4719 [labelType="html" label="PythonRDD [4719]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10529 { label="MicroBatchScan"; 4705 [labelType="html" label="DataSourceRDD [4705]<br>run at <unknown>:0"]; 4706 [labelType="html" label="MapPartitionsRDD [4706]<br>run at <unknown>:0"]; } subgraph cluster10528 { label="Project"; 4707 [labelType="html" label="MapPartitionsRDD [4707]<br>run at <unknown>:0"]; } subgraph cluster10524 { label="WholeStageCodegen (1)"; 4708 [labelType="html" label="MapPartitionsRDD [4708]<br>run at <unknown>:0"]; } subgraph cluster10538 { label="WholeStageCodegen (1)"; 4710 [labelType="html" label="MapPartitionsRDD [4710]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10537 { label="Filter"; 4711 [labelType="html" label="MapPartitionsRDD [4711]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10536 { label="Project"; 4712 [labelType="html" label="MapPartitionsRDD [4712]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10533 { label="WholeStageCodegen (2)"; 4713 [labelType="html" label="MapPartitionsRDD [4713]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10532 { label="Project"; 4714 [labelType="html" label="MapPartitionsRDD [4714]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10531 { label="DeserializeToObject"; 4715 [labelType="html" label="MapPartitionsRDD [4715]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10530 { label="MapPartitions"; 4716 [labelType="html" label="MapPartitionsRDD [4716]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10540 { label="mapPartitions"; 4718 [labelType="html" label="MapPartitionsRDD [4718]<br>toJavaRDD at <unknown>:0"]; } } 4705->4706; 4706->4707; 4707->4708; 4708->4709; 4709->4710; 4710->4711; 4711->4712; 4712->4713; 4713->4714; 4714->4715; 4715->4716; 4716->4717; 4717->4718; 4718->4719; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time