3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1192 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 364
Associated Job Ids:
1193
DAG Visualization
digraph G { subgraph clusterstage_1192 { label="Stage 1192"; 12521 [labelType="html" label="SQLExecutionRDD [12521]<br>run at <unknown>:0"]; 12535 [labelType="html" label="SQLExecutionRDD [12535]<br>toJavaRDD at <unknown>:0"]; 12537 [labelType="html" label="PythonRDD [12537]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster28013 { label="MicroBatchScan"; 12517 [labelType="html" label="DataSourceRDD [12517]<br>run at <unknown>:0"]; 12518 [labelType="html" label="MapPartitionsRDD [12518]<br>run at <unknown>:0"]; } subgraph cluster28012 { label="Project"; 12519 [labelType="html" label="MapPartitionsRDD [12519]<br>run at <unknown>:0"]; } subgraph cluster28008 { label="WholeStageCodegen (1)"; 12520 [labelType="html" label="MapPartitionsRDD [12520]<br>run at <unknown>:0"]; } subgraph cluster28030 { label="WholeStageCodegen (1)"; 12528 [labelType="html" label="MapPartitionsRDD [12528]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28029 { label="Filter"; 12529 [labelType="html" label="MapPartitionsRDD [12529]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28028 { label="Project"; 12530 [labelType="html" label="MapPartitionsRDD [12530]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28025 { label="WholeStageCodegen (2)"; 12531 [labelType="html" label="MapPartitionsRDD [12531]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28024 { label="Project"; 12532 [labelType="html" label="MapPartitionsRDD [12532]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28023 { label="DeserializeToObject"; 12533 [labelType="html" label="MapPartitionsRDD [12533]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28022 { label="MapPartitions"; 12534 [labelType="html" label="MapPartitionsRDD [12534]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster28032 { label="mapPartitions"; 12536 [labelType="html" label="MapPartitionsRDD [12536]<br>toJavaRDD at <unknown>:0"]; } } 12517->12518; 12518->12519; 12519->12520; 12520->12521; 12521->12528; 12528->12529; 12529->12530; 12530->12531; 12531->12532; 12532->12533; 12533->12534; 12534->12535; 12535->12536; 12536->12537; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time