3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 798 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 548
Associated Job Ids:
798
DAG Visualization
digraph G { subgraph clusterstage_798 { label="Stage 798"; 8383 [labelType="html" label="SQLExecutionRDD [8383]<br>run at <unknown>:0"]; 8391 [labelType="html" label="SQLExecutionRDD [8391]<br>toJavaRDD at <unknown>:0"]; 8393 [labelType="html" label="PythonRDD [8393]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster18758 { label="MicroBatchScan"; 8379 [labelType="html" label="DataSourceRDD [8379]<br>run at <unknown>:0"]; 8380 [labelType="html" label="MapPartitionsRDD [8380]<br>run at <unknown>:0"]; } subgraph cluster18757 { label="Project"; 8381 [labelType="html" label="MapPartitionsRDD [8381]<br>run at <unknown>:0"]; } subgraph cluster18753 { label="WholeStageCodegen (1)"; 8382 [labelType="html" label="MapPartitionsRDD [8382]<br>run at <unknown>:0"]; } subgraph cluster18767 { label="WholeStageCodegen (1)"; 8384 [labelType="html" label="MapPartitionsRDD [8384]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18766 { label="Filter"; 8385 [labelType="html" label="MapPartitionsRDD [8385]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18765 { label="Project"; 8386 [labelType="html" label="MapPartitionsRDD [8386]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18762 { label="WholeStageCodegen (2)"; 8387 [labelType="html" label="MapPartitionsRDD [8387]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18761 { label="Project"; 8388 [labelType="html" label="MapPartitionsRDD [8388]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18760 { label="DeserializeToObject"; 8389 [labelType="html" label="MapPartitionsRDD [8389]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18759 { label="MapPartitions"; 8390 [labelType="html" label="MapPartitionsRDD [8390]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster18769 { label="mapPartitions"; 8392 [labelType="html" label="MapPartitionsRDD [8392]<br>toJavaRDD at <unknown>:0"]; } } 8379->8380; 8380->8381; 8381->8382; 8382->8383; 8383->8384; 8384->8385; 8385->8386; 8386->8387; 8387->8388; 8388->8389; 8389->8390; 8390->8391; 8391->8392; 8392->8393; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time