3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1874 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 430
Associated Job Ids:
1874
DAG Visualization
digraph G { subgraph clusterstage_1874 { label="Stage 1874"; 19681 [labelType="html" label="SQLExecutionRDD [19681]<br>run at <unknown>:0"]; 19689 [labelType="html" label="SQLExecutionRDD [19689]<br>toJavaRDD at <unknown>:0"]; 19691 [labelType="html" label="PythonRDD [19691]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44044 { label="MicroBatchScan"; 19677 [labelType="html" label="DataSourceRDD [19677]<br>run at <unknown>:0"]; 19678 [labelType="html" label="MapPartitionsRDD [19678]<br>run at <unknown>:0"]; } subgraph cluster44043 { label="Project"; 19679 [labelType="html" label="MapPartitionsRDD [19679]<br>run at <unknown>:0"]; } subgraph cluster44039 { label="WholeStageCodegen (1)"; 19680 [labelType="html" label="MapPartitionsRDD [19680]<br>run at <unknown>:0"]; } subgraph cluster44053 { label="WholeStageCodegen (1)"; 19682 [labelType="html" label="MapPartitionsRDD [19682]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44052 { label="Filter"; 19683 [labelType="html" label="MapPartitionsRDD [19683]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44051 { label="Project"; 19684 [labelType="html" label="MapPartitionsRDD [19684]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44048 { label="WholeStageCodegen (2)"; 19685 [labelType="html" label="MapPartitionsRDD [19685]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44047 { label="Project"; 19686 [labelType="html" label="MapPartitionsRDD [19686]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44046 { label="DeserializeToObject"; 19687 [labelType="html" label="MapPartitionsRDD [19687]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44045 { label="MapPartitions"; 19688 [labelType="html" label="MapPartitionsRDD [19688]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44055 { label="mapPartitions"; 19690 [labelType="html" label="MapPartitionsRDD [19690]<br>toJavaRDD at <unknown>:0"]; } } 19677->19678; 19678->19679; 19679->19680; 19680->19681; 19681->19682; 19682->19683; 19683->19684; 19684->19685; 19685->19686; 19686->19687; 19687->19688; 19688->19689; 19689->19690; 19690->19691; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time