3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 430 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 458
Associated Job Ids:
430
DAG Visualization
digraph G { subgraph clusterstage_430 { label="Stage 430"; 4519 [labelType="html" label="SQLExecutionRDD [4519]<br>run at <unknown>:0"]; 4527 [labelType="html" label="SQLExecutionRDD [4527]<br>toJavaRDD at <unknown>:0"]; 4529 [labelType="html" label="PythonRDD [4529]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10110 { label="MicroBatchScan"; 4515 [labelType="html" label="DataSourceRDD [4515]<br>run at <unknown>:0"]; 4516 [labelType="html" label="MapPartitionsRDD [4516]<br>run at <unknown>:0"]; } subgraph cluster10109 { label="Project"; 4517 [labelType="html" label="MapPartitionsRDD [4517]<br>run at <unknown>:0"]; } subgraph cluster10105 { label="WholeStageCodegen (1)"; 4518 [labelType="html" label="MapPartitionsRDD [4518]<br>run at <unknown>:0"]; } subgraph cluster10119 { label="WholeStageCodegen (1)"; 4520 [labelType="html" label="MapPartitionsRDD [4520]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10118 { label="Filter"; 4521 [labelType="html" label="MapPartitionsRDD [4521]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10117 { label="Project"; 4522 [labelType="html" label="MapPartitionsRDD [4522]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10114 { label="WholeStageCodegen (2)"; 4523 [labelType="html" label="MapPartitionsRDD [4523]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10113 { label="Project"; 4524 [labelType="html" label="MapPartitionsRDD [4524]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10112 { label="DeserializeToObject"; 4525 [labelType="html" label="MapPartitionsRDD [4525]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10111 { label="MapPartitions"; 4526 [labelType="html" label="MapPartitionsRDD [4526]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10121 { label="mapPartitions"; 4528 [labelType="html" label="MapPartitionsRDD [4528]<br>toJavaRDD at <unknown>:0"]; } } 4515->4516; 4516->4517; 4517->4518; 4518->4519; 4519->4520; 4520->4521; 4521->4522; 4522->4523; 4523->4524; 4524->4525; 4525->4526; 4526->4527; 4527->4528; 4528->4529; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time