3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 404 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 429
Associated Job Ids:
404
DAG Visualization
digraph G { subgraph clusterstage_404 { label="Stage 404"; 4246 [labelType="html" label="SQLExecutionRDD [4246]<br>run at <unknown>:0"]; 4254 [labelType="html" label="SQLExecutionRDD [4254]<br>toJavaRDD at <unknown>:0"]; 4256 [labelType="html" label="PythonRDD [4256]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster9499 { label="MicroBatchScan"; 4242 [labelType="html" label="DataSourceRDD [4242]<br>run at <unknown>:0"]; 4243 [labelType="html" label="MapPartitionsRDD [4243]<br>run at <unknown>:0"]; } subgraph cluster9498 { label="Project"; 4244 [labelType="html" label="MapPartitionsRDD [4244]<br>run at <unknown>:0"]; } subgraph cluster9494 { label="WholeStageCodegen (1)"; 4245 [labelType="html" label="MapPartitionsRDD [4245]<br>run at <unknown>:0"]; } subgraph cluster9508 { label="WholeStageCodegen (1)"; 4247 [labelType="html" label="MapPartitionsRDD [4247]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9507 { label="Filter"; 4248 [labelType="html" label="MapPartitionsRDD [4248]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9506 { label="Project"; 4249 [labelType="html" label="MapPartitionsRDD [4249]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9503 { label="WholeStageCodegen (2)"; 4250 [labelType="html" label="MapPartitionsRDD [4250]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9502 { label="Project"; 4251 [labelType="html" label="MapPartitionsRDD [4251]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9501 { label="DeserializeToObject"; 4252 [labelType="html" label="MapPartitionsRDD [4252]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9500 { label="MapPartitions"; 4253 [labelType="html" label="MapPartitionsRDD [4253]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9510 { label="mapPartitions"; 4255 [labelType="html" label="MapPartitionsRDD [4255]<br>toJavaRDD at <unknown>:0"]; } } 4242->4243; 4243->4244; 4244->4245; 4245->4246; 4246->4247; 4247->4248; 4248->4249; 4249->4250; 4250->4251; 4251->4252; 4252->4253; 4253->4254; 4254->4255; 4255->4256; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time