3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 364 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 378
Associated Job Ids:
364
DAG Visualization
digraph G { subgraph clusterstage_364 { label="Stage 364"; 3826 [labelType="html" label="SQLExecutionRDD [3826]<br>run at <unknown>:0"]; 3834 [labelType="html" label="SQLExecutionRDD [3834]<br>toJavaRDD at <unknown>:0"]; 3836 [labelType="html" label="PythonRDD [3836]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8559 { label="MicroBatchScan"; 3822 [labelType="html" label="DataSourceRDD [3822]<br>run at <unknown>:0"]; 3823 [labelType="html" label="MapPartitionsRDD [3823]<br>run at <unknown>:0"]; } subgraph cluster8558 { label="Project"; 3824 [labelType="html" label="MapPartitionsRDD [3824]<br>run at <unknown>:0"]; } subgraph cluster8554 { label="WholeStageCodegen (1)"; 3825 [labelType="html" label="MapPartitionsRDD [3825]<br>run at <unknown>:0"]; } subgraph cluster8568 { label="WholeStageCodegen (1)"; 3827 [labelType="html" label="MapPartitionsRDD [3827]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8567 { label="Filter"; 3828 [labelType="html" label="MapPartitionsRDD [3828]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8566 { label="Project"; 3829 [labelType="html" label="MapPartitionsRDD [3829]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8563 { label="WholeStageCodegen (2)"; 3830 [labelType="html" label="MapPartitionsRDD [3830]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8562 { label="Project"; 3831 [labelType="html" label="MapPartitionsRDD [3831]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8561 { label="DeserializeToObject"; 3832 [labelType="html" label="MapPartitionsRDD [3832]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8560 { label="MapPartitions"; 3833 [labelType="html" label="MapPartitionsRDD [3833]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8570 { label="mapPartitions"; 3835 [labelType="html" label="MapPartitionsRDD [3835]<br>toJavaRDD at <unknown>:0"]; } } 3822->3823; 3823->3824; 3824->3825; 3825->3826; 3826->3827; 3827->3828; 3828->3829; 3829->3830; 3830->3831; 3831->3832; 3832->3833; 3833->3834; 3834->3835; 3835->3836; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time