3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1367 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 442
Associated Job Ids:
1368
DAG Visualization
digraph G { subgraph clusterstage_1367 { label="Stage 1367"; 14369 [labelType="html" label="SQLExecutionRDD [14369]<br>run at <unknown>:0"]; 14377 [labelType="html" label="SQLExecutionRDD [14377]<br>toJavaRDD at <unknown>:0"]; 14379 [labelType="html" label="PythonRDD [14379]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32149 { label="MicroBatchScan"; 14365 [labelType="html" label="DataSourceRDD [14365]<br>run at <unknown>:0"]; 14366 [labelType="html" label="MapPartitionsRDD [14366]<br>run at <unknown>:0"]; } subgraph cluster32148 { label="Project"; 14367 [labelType="html" label="MapPartitionsRDD [14367]<br>run at <unknown>:0"]; } subgraph cluster32144 { label="WholeStageCodegen (1)"; 14368 [labelType="html" label="MapPartitionsRDD [14368]<br>run at <unknown>:0"]; } subgraph cluster32158 { label="WholeStageCodegen (1)"; 14370 [labelType="html" label="MapPartitionsRDD [14370]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32157 { label="Filter"; 14371 [labelType="html" label="MapPartitionsRDD [14371]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32156 { label="Project"; 14372 [labelType="html" label="MapPartitionsRDD [14372]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32153 { label="WholeStageCodegen (2)"; 14373 [labelType="html" label="MapPartitionsRDD [14373]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32152 { label="Project"; 14374 [labelType="html" label="MapPartitionsRDD [14374]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32151 { label="DeserializeToObject"; 14375 [labelType="html" label="MapPartitionsRDD [14375]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32150 { label="MapPartitions"; 14376 [labelType="html" label="MapPartitionsRDD [14376]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32160 { label="mapPartitions"; 14378 [labelType="html" label="MapPartitionsRDD [14378]<br>toJavaRDD at <unknown>:0"]; } } 14365->14366; 14366->14367; 14367->14368; 14368->14369; 14369->14370; 14370->14371; 14371->14372; 14372->14373; 14373->14374; 14374->14375; 14375->14376; 14376->14377; 14377->14378; 14378->14379; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time