3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 248 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 417
Associated Job Ids:
248
DAG Visualization
digraph G { subgraph clusterstage_248 { label="Stage 248"; 2608 [labelType="html" label="SQLExecutionRDD [2608]<br>run at <unknown>:0"]; 2616 [labelType="html" label="SQLExecutionRDD [2616]<br>toJavaRDD at <unknown>:0"]; 2618 [labelType="html" label="PythonRDD [2618]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster5833 { label="MicroBatchScan"; 2604 [labelType="html" label="DataSourceRDD [2604]<br>run at <unknown>:0"]; 2605 [labelType="html" label="MapPartitionsRDD [2605]<br>run at <unknown>:0"]; } subgraph cluster5832 { label="Project"; 2606 [labelType="html" label="MapPartitionsRDD [2606]<br>run at <unknown>:0"]; } subgraph cluster5828 { label="WholeStageCodegen (1)"; 2607 [labelType="html" label="MapPartitionsRDD [2607]<br>run at <unknown>:0"]; } subgraph cluster5842 { label="WholeStageCodegen (1)"; 2609 [labelType="html" label="MapPartitionsRDD [2609]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5841 { label="Filter"; 2610 [labelType="html" label="MapPartitionsRDD [2610]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5840 { label="Project"; 2611 [labelType="html" label="MapPartitionsRDD [2611]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5837 { label="WholeStageCodegen (2)"; 2612 [labelType="html" label="MapPartitionsRDD [2612]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5836 { label="Project"; 2613 [labelType="html" label="MapPartitionsRDD [2613]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5835 { label="DeserializeToObject"; 2614 [labelType="html" label="MapPartitionsRDD [2614]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5834 { label="MapPartitions"; 2615 [labelType="html" label="MapPartitionsRDD [2615]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5844 { label="mapPartitions"; 2617 [labelType="html" label="MapPartitionsRDD [2617]<br>toJavaRDD at <unknown>:0"]; } } 2604->2605; 2605->2606; 2606->2607; 2607->2608; 2608->2609; 2609->2610; 2610->2611; 2611->2612; 2612->2613; 2613->2614; 2614->2615; 2615->2616; 2616->2617; 2617->2618; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time