3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 876 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 478
Associated Job Ids:
876
DAG Visualization
digraph G { subgraph clusterstage_876 { label="Stage 876"; 9202 [labelType="html" label="SQLExecutionRDD [9202]<br>run at <unknown>:0"]; 9210 [labelType="html" label="SQLExecutionRDD [9210]<br>toJavaRDD at <unknown>:0"]; 9212 [labelType="html" label="PythonRDD [9212]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20591 { label="MicroBatchScan"; 9198 [labelType="html" label="DataSourceRDD [9198]<br>run at <unknown>:0"]; 9199 [labelType="html" label="MapPartitionsRDD [9199]<br>run at <unknown>:0"]; } subgraph cluster20590 { label="Project"; 9200 [labelType="html" label="MapPartitionsRDD [9200]<br>run at <unknown>:0"]; } subgraph cluster20586 { label="WholeStageCodegen (1)"; 9201 [labelType="html" label="MapPartitionsRDD [9201]<br>run at <unknown>:0"]; } subgraph cluster20600 { label="WholeStageCodegen (1)"; 9203 [labelType="html" label="MapPartitionsRDD [9203]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20599 { label="Filter"; 9204 [labelType="html" label="MapPartitionsRDD [9204]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20598 { label="Project"; 9205 [labelType="html" label="MapPartitionsRDD [9205]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20595 { label="WholeStageCodegen (2)"; 9206 [labelType="html" label="MapPartitionsRDD [9206]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20594 { label="Project"; 9207 [labelType="html" label="MapPartitionsRDD [9207]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20593 { label="DeserializeToObject"; 9208 [labelType="html" label="MapPartitionsRDD [9208]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20592 { label="MapPartitions"; 9209 [labelType="html" label="MapPartitionsRDD [9209]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20602 { label="mapPartitions"; 9211 [labelType="html" label="MapPartitionsRDD [9211]<br>toJavaRDD at <unknown>:0"]; } } 9198->9199; 9199->9200; 9200->9201; 9201->9202; 9202->9203; 9203->9204; 9204->9205; 9205->9206; 9206->9207; 9207->9208; 9208->9209; 9209->9210; 9210->9211; 9211->9212; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time