3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 401 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 516
Associated Job Ids:
401
DAG Visualization
digraph G { subgraph clusterstage_401 { label="Stage 401"; 4204 [labelType="html" label="SQLExecutionRDD [4204]<br>run at <unknown>:0"]; 4218 [labelType="html" label="SQLExecutionRDD [4218]<br>toJavaRDD at <unknown>:0"]; 4220 [labelType="html" label="PythonRDD [4220]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9405 { label="MicroBatchScan"; 4200 [labelType="html" label="DataSourceRDD [4200]<br>run at <unknown>:0"]; 4201 [labelType="html" label="MapPartitionsRDD [4201]<br>run at <unknown>:0"]; } subgraph cluster9404 { label="Project"; 4202 [labelType="html" label="MapPartitionsRDD [4202]<br>run at <unknown>:0"]; } subgraph cluster9400 { label="WholeStageCodegen (1)"; 4203 [labelType="html" label="MapPartitionsRDD [4203]<br>run at <unknown>:0"]; } subgraph cluster9422 { label="WholeStageCodegen (1)"; 4211 [labelType="html" label="MapPartitionsRDD [4211]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9421 { label="Filter"; 4212 [labelType="html" label="MapPartitionsRDD [4212]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9420 { label="Project"; 4213 [labelType="html" label="MapPartitionsRDD [4213]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9417 { label="WholeStageCodegen (2)"; 4214 [labelType="html" label="MapPartitionsRDD [4214]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9416 { label="Project"; 4215 [labelType="html" label="MapPartitionsRDD [4215]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9415 { label="DeserializeToObject"; 4216 [labelType="html" label="MapPartitionsRDD [4216]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9414 { label="MapPartitions"; 4217 [labelType="html" label="MapPartitionsRDD [4217]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9424 { label="mapPartitions"; 4219 [labelType="html" label="MapPartitionsRDD [4219]<br>toJavaRDD at <unknown>:0"]; } } 4200->4201; 4201->4202; 4202->4203; 4203->4204; 4204->4211; 4211->4212; 4212->4213; 4213->4214; 4214->4215; 4215->4216; 4216->4217; 4217->4218; 4218->4219; 4219->4220; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time