3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 824 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 327
Associated Job Ids:
824
DAG Visualization
digraph G { subgraph clusterstage_824 { label="Stage 824"; 8656 [labelType="html" label="SQLExecutionRDD [8656]<br>run at <unknown>:0"]; 8664 [labelType="html" label="SQLExecutionRDD [8664]<br>toJavaRDD at <unknown>:0"]; 8666 [labelType="html" label="PythonRDD [8666]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19369 { label="MicroBatchScan"; 8652 [labelType="html" label="DataSourceRDD [8652]<br>run at <unknown>:0"]; 8653 [labelType="html" label="MapPartitionsRDD [8653]<br>run at <unknown>:0"]; } subgraph cluster19368 { label="Project"; 8654 [labelType="html" label="MapPartitionsRDD [8654]<br>run at <unknown>:0"]; } subgraph cluster19364 { label="WholeStageCodegen (1)"; 8655 [labelType="html" label="MapPartitionsRDD [8655]<br>run at <unknown>:0"]; } subgraph cluster19378 { label="WholeStageCodegen (1)"; 8657 [labelType="html" label="MapPartitionsRDD [8657]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19377 { label="Filter"; 8658 [labelType="html" label="MapPartitionsRDD [8658]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19376 { label="Project"; 8659 [labelType="html" label="MapPartitionsRDD [8659]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19373 { label="WholeStageCodegen (2)"; 8660 [labelType="html" label="MapPartitionsRDD [8660]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19372 { label="Project"; 8661 [labelType="html" label="MapPartitionsRDD [8661]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19371 { label="DeserializeToObject"; 8662 [labelType="html" label="MapPartitionsRDD [8662]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19370 { label="MapPartitions"; 8663 [labelType="html" label="MapPartitionsRDD [8663]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19380 { label="mapPartitions"; 8665 [labelType="html" label="MapPartitionsRDD [8665]<br>toJavaRDD at <unknown>:0"]; } } 8652->8653; 8653->8654; 8654->8655; 8655->8656; 8656->8657; 8657->8658; 8658->8659; 8659->8660; 8660->8661; 8661->8662; 8662->8663; 8663->8664; 8664->8665; 8665->8666; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time