3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 613 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 423
Associated Job Ids:
614
DAG Visualization
digraph G { subgraph clusterstage_613 { label="Stage 613"; 6452 [labelType="html" label="SQLExecutionRDD [6452]<br>run at <unknown>:0"]; 6460 [labelType="html" label="SQLExecutionRDD [6460]<br>toJavaRDD at <unknown>:0"]; 6462 [labelType="html" label="PythonRDD [6462]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14430 { label="MicroBatchScan"; 6448 [labelType="html" label="DataSourceRDD [6448]<br>run at <unknown>:0"]; 6449 [labelType="html" label="MapPartitionsRDD [6449]<br>run at <unknown>:0"]; } subgraph cluster14429 { label="Project"; 6450 [labelType="html" label="MapPartitionsRDD [6450]<br>run at <unknown>:0"]; } subgraph cluster14425 { label="WholeStageCodegen (1)"; 6451 [labelType="html" label="MapPartitionsRDD [6451]<br>run at <unknown>:0"]; } subgraph cluster14439 { label="WholeStageCodegen (1)"; 6453 [labelType="html" label="MapPartitionsRDD [6453]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14438 { label="Filter"; 6454 [labelType="html" label="MapPartitionsRDD [6454]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14437 { label="Project"; 6455 [labelType="html" label="MapPartitionsRDD [6455]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14434 { label="WholeStageCodegen (2)"; 6456 [labelType="html" label="MapPartitionsRDD [6456]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14433 { label="Project"; 6457 [labelType="html" label="MapPartitionsRDD [6457]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14432 { label="DeserializeToObject"; 6458 [labelType="html" label="MapPartitionsRDD [6458]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14431 { label="MapPartitions"; 6459 [labelType="html" label="MapPartitionsRDD [6459]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14441 { label="mapPartitions"; 6461 [labelType="html" label="MapPartitionsRDD [6461]<br>toJavaRDD at <unknown>:0"]; } } 6448->6449; 6449->6450; 6450->6451; 6451->6452; 6452->6453; 6453->6454; 6454->6455; 6455->6456; 6456->6457; 6457->6458; 6458->6459; 6459->6460; 6460->6461; 6461->6462; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time