3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 532 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 415
Associated Job Ids:
532
DAG Visualization
digraph G { subgraph clusterstage_532 { label="Stage 532"; 5590 [labelType="html" label="SQLExecutionRDD [5590]<br>run at <unknown>:0"]; 5598 [labelType="html" label="SQLExecutionRDD [5598]<br>toJavaRDD at <unknown>:0"]; 5600 [labelType="html" label="PythonRDD [5600]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12507 { label="MicroBatchScan"; 5586 [labelType="html" label="DataSourceRDD [5586]<br>run at <unknown>:0"]; 5587 [labelType="html" label="MapPartitionsRDD [5587]<br>run at <unknown>:0"]; } subgraph cluster12506 { label="Project"; 5588 [labelType="html" label="MapPartitionsRDD [5588]<br>run at <unknown>:0"]; } subgraph cluster12502 { label="WholeStageCodegen (1)"; 5589 [labelType="html" label="MapPartitionsRDD [5589]<br>run at <unknown>:0"]; } subgraph cluster12516 { label="WholeStageCodegen (1)"; 5591 [labelType="html" label="MapPartitionsRDD [5591]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12515 { label="Filter"; 5592 [labelType="html" label="MapPartitionsRDD [5592]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12514 { label="Project"; 5593 [labelType="html" label="MapPartitionsRDD [5593]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12511 { label="WholeStageCodegen (2)"; 5594 [labelType="html" label="MapPartitionsRDD [5594]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12510 { label="Project"; 5595 [labelType="html" label="MapPartitionsRDD [5595]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12509 { label="DeserializeToObject"; 5596 [labelType="html" label="MapPartitionsRDD [5596]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12508 { label="MapPartitions"; 5597 [labelType="html" label="MapPartitionsRDD [5597]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12518 { label="mapPartitions"; 5599 [labelType="html" label="MapPartitionsRDD [5599]<br>toJavaRDD at <unknown>:0"]; } } 5586->5587; 5587->5588; 5588->5589; 5589->5590; 5590->5591; 5591->5592; 5592->5593; 5593->5594; 5594->5595; 5595->5596; 5596->5597; 5597->5598; 5598->5599; 5599->5600; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time