3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2039 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 452
Associated Job Ids:
2040
DAG Visualization
digraph G { subgraph clusterstage_2039 { label="Stage 2039"; 21425 [labelType="html" label="SQLExecutionRDD [21425]<br>run at <unknown>:0"]; 21433 [labelType="html" label="SQLExecutionRDD [21433]<br>toJavaRDD at <unknown>:0"]; 21435 [labelType="html" label="PythonRDD [21435]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47941 { label="MicroBatchScan"; 21421 [labelType="html" label="DataSourceRDD [21421]<br>run at <unknown>:0"]; 21422 [labelType="html" label="MapPartitionsRDD [21422]<br>run at <unknown>:0"]; } subgraph cluster47940 { label="Project"; 21423 [labelType="html" label="MapPartitionsRDD [21423]<br>run at <unknown>:0"]; } subgraph cluster47936 { label="WholeStageCodegen (1)"; 21424 [labelType="html" label="MapPartitionsRDD [21424]<br>run at <unknown>:0"]; } subgraph cluster47950 { label="WholeStageCodegen (1)"; 21426 [labelType="html" label="MapPartitionsRDD [21426]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47949 { label="Filter"; 21427 [labelType="html" label="MapPartitionsRDD [21427]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47948 { label="Project"; 21428 [labelType="html" label="MapPartitionsRDD [21428]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47945 { label="WholeStageCodegen (2)"; 21429 [labelType="html" label="MapPartitionsRDD [21429]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47944 { label="Project"; 21430 [labelType="html" label="MapPartitionsRDD [21430]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47943 { label="DeserializeToObject"; 21431 [labelType="html" label="MapPartitionsRDD [21431]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47942 { label="MapPartitions"; 21432 [labelType="html" label="MapPartitionsRDD [21432]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47952 { label="mapPartitions"; 21434 [labelType="html" label="MapPartitionsRDD [21434]<br>toJavaRDD at <unknown>:0"]; } } 21421->21422; 21422->21423; 21423->21424; 21424->21425; 21425->21426; 21426->21427; 21427->21428; 21428->21429; 21429->21430; 21430->21431; 21431->21432; 21432->21433; 21433->21434; 21434->21435; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time