3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 916 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 363
Associated Job Ids:
916
DAG Visualization
digraph G { subgraph clusterstage_916 { label="Stage 916"; 9622 [labelType="html" label="SQLExecutionRDD [9622]<br>run at <unknown>:0"]; 9630 [labelType="html" label="SQLExecutionRDD [9630]<br>toJavaRDD at <unknown>:0"]; 9632 [labelType="html" label="PythonRDD [9632]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21531 { label="MicroBatchScan"; 9618 [labelType="html" label="DataSourceRDD [9618]<br>run at <unknown>:0"]; 9619 [labelType="html" label="MapPartitionsRDD [9619]<br>run at <unknown>:0"]; } subgraph cluster21530 { label="Project"; 9620 [labelType="html" label="MapPartitionsRDD [9620]<br>run at <unknown>:0"]; } subgraph cluster21526 { label="WholeStageCodegen (1)"; 9621 [labelType="html" label="MapPartitionsRDD [9621]<br>run at <unknown>:0"]; } subgraph cluster21540 { label="WholeStageCodegen (1)"; 9623 [labelType="html" label="MapPartitionsRDD [9623]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21539 { label="Filter"; 9624 [labelType="html" label="MapPartitionsRDD [9624]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21538 { label="Project"; 9625 [labelType="html" label="MapPartitionsRDD [9625]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21535 { label="WholeStageCodegen (2)"; 9626 [labelType="html" label="MapPartitionsRDD [9626]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21534 { label="Project"; 9627 [labelType="html" label="MapPartitionsRDD [9627]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21533 { label="DeserializeToObject"; 9628 [labelType="html" label="MapPartitionsRDD [9628]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21532 { label="MapPartitions"; 9629 [labelType="html" label="MapPartitionsRDD [9629]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21542 { label="mapPartitions"; 9631 [labelType="html" label="MapPartitionsRDD [9631]<br>toJavaRDD at <unknown>:0"]; } } 9618->9619; 9619->9620; 9620->9621; 9621->9622; 9622->9623; 9623->9624; 9624->9625; 9625->9626; 9626->9627; 9627->9628; 9628->9629; 9629->9630; 9630->9631; 9631->9632; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time