3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1104 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 179
Associated Job Ids:
1105
DAG Visualization
digraph G { subgraph clusterstage_1104 { label="Stage 1104"; 11603 [labelType="html" label="SQLExecutionRDD [11603]<br>run at <unknown>:0"]; 11611 [labelType="html" label="SQLExecutionRDD [11611]<br>toJavaRDD at <unknown>:0"]; 11613 [labelType="html" label="PythonRDD [11613]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster25953 { label="MicroBatchScan"; 11599 [labelType="html" label="DataSourceRDD [11599]<br>run at <unknown>:0"]; 11600 [labelType="html" label="MapPartitionsRDD [11600]<br>run at <unknown>:0"]; } subgraph cluster25952 { label="Project"; 11601 [labelType="html" label="MapPartitionsRDD [11601]<br>run at <unknown>:0"]; } subgraph cluster25948 { label="WholeStageCodegen (1)"; 11602 [labelType="html" label="MapPartitionsRDD [11602]<br>run at <unknown>:0"]; } subgraph cluster25962 { label="WholeStageCodegen (1)"; 11604 [labelType="html" label="MapPartitionsRDD [11604]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25961 { label="Filter"; 11605 [labelType="html" label="MapPartitionsRDD [11605]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25960 { label="Project"; 11606 [labelType="html" label="MapPartitionsRDD [11606]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25957 { label="WholeStageCodegen (2)"; 11607 [labelType="html" label="MapPartitionsRDD [11607]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25956 { label="Project"; 11608 [labelType="html" label="MapPartitionsRDD [11608]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25955 { label="DeserializeToObject"; 11609 [labelType="html" label="MapPartitionsRDD [11609]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25954 { label="MapPartitions"; 11610 [labelType="html" label="MapPartitionsRDD [11610]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster25964 { label="mapPartitions"; 11612 [labelType="html" label="MapPartitionsRDD [11612]<br>toJavaRDD at <unknown>:0"]; } } 11599->11600; 11600->11601; 11601->11602; 11602->11603; 11603->11604; 11604->11605; 11605->11606; 11606->11607; 11607->11608; 11608->11609; 11609->11610; 11610->11611; 11611->11612; 11612->11613; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time