3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 891 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 437
Associated Job Ids:
891
DAG Visualization
digraph G { subgraph clusterstage_891 { label="Stage 891"; 9355 [labelType="html" label="SQLExecutionRDD [9355]<br>run at <unknown>:0"]; 9363 [labelType="html" label="SQLExecutionRDD [9363]<br>toJavaRDD at <unknown>:0"]; 9365 [labelType="html" label="PythonRDD [9365]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20928 { label="MicroBatchScan"; 9351 [labelType="html" label="DataSourceRDD [9351]<br>run at <unknown>:0"]; 9352 [labelType="html" label="MapPartitionsRDD [9352]<br>run at <unknown>:0"]; } subgraph cluster20927 { label="Project"; 9353 [labelType="html" label="MapPartitionsRDD [9353]<br>run at <unknown>:0"]; } subgraph cluster20923 { label="WholeStageCodegen (1)"; 9354 [labelType="html" label="MapPartitionsRDD [9354]<br>run at <unknown>:0"]; } subgraph cluster20937 { label="WholeStageCodegen (1)"; 9356 [labelType="html" label="MapPartitionsRDD [9356]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20936 { label="Filter"; 9357 [labelType="html" label="MapPartitionsRDD [9357]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20935 { label="Project"; 9358 [labelType="html" label="MapPartitionsRDD [9358]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20932 { label="WholeStageCodegen (2)"; 9359 [labelType="html" label="MapPartitionsRDD [9359]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20931 { label="Project"; 9360 [labelType="html" label="MapPartitionsRDD [9360]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20930 { label="DeserializeToObject"; 9361 [labelType="html" label="MapPartitionsRDD [9361]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20929 { label="MapPartitions"; 9362 [labelType="html" label="MapPartitionsRDD [9362]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20939 { label="mapPartitions"; 9364 [labelType="html" label="MapPartitionsRDD [9364]<br>toJavaRDD at <unknown>:0"]; } } 9351->9352; 9352->9353; 9353->9354; 9354->9355; 9355->9356; 9356->9357; 9357->9358; 9358->9359; 9359->9360; 9360->9361; 9361->9362; 9362->9363; 9363->9364; 9364->9365; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time