3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 859 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 416
Associated Job Ids:
859
DAG Visualization
digraph G { subgraph clusterstage_859 { label="Stage 859"; 9013 [labelType="html" label="SQLExecutionRDD [9013]<br>run at <unknown>:0"]; 9027 [labelType="html" label="SQLExecutionRDD [9027]<br>toJavaRDD at <unknown>:0"]; 9029 [labelType="html" label="PythonRDD [9029]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20168 { label="MicroBatchScan"; 9009 [labelType="html" label="DataSourceRDD [9009]<br>run at <unknown>:0"]; 9010 [labelType="html" label="MapPartitionsRDD [9010]<br>run at <unknown>:0"]; } subgraph cluster20167 { label="Project"; 9011 [labelType="html" label="MapPartitionsRDD [9011]<br>run at <unknown>:0"]; } subgraph cluster20163 { label="WholeStageCodegen (1)"; 9012 [labelType="html" label="MapPartitionsRDD [9012]<br>run at <unknown>:0"]; } subgraph cluster20185 { label="WholeStageCodegen (1)"; 9020 [labelType="html" label="MapPartitionsRDD [9020]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20184 { label="Filter"; 9021 [labelType="html" label="MapPartitionsRDD [9021]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20183 { label="Project"; 9022 [labelType="html" label="MapPartitionsRDD [9022]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20180 { label="WholeStageCodegen (2)"; 9023 [labelType="html" label="MapPartitionsRDD [9023]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20179 { label="Project"; 9024 [labelType="html" label="MapPartitionsRDD [9024]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20178 { label="DeserializeToObject"; 9025 [labelType="html" label="MapPartitionsRDD [9025]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20177 { label="MapPartitions"; 9026 [labelType="html" label="MapPartitionsRDD [9026]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20187 { label="mapPartitions"; 9028 [labelType="html" label="MapPartitionsRDD [9028]<br>toJavaRDD at <unknown>:0"]; } } 9009->9010; 9010->9011; 9011->9012; 9012->9013; 9013->9020; 9020->9021; 9021->9022; 9022->9023; 9023->9024; 9024->9025; 9025->9026; 9026->9027; 9027->9028; 9028->9029; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time