3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2003 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 461
Associated Job Ids:
2004
DAG Visualization
digraph G { subgraph clusterstage_2003 { label="Stage 2003"; 21047 [labelType="html" label="SQLExecutionRDD [21047]<br>run at <unknown>:0"]; 21055 [labelType="html" label="SQLExecutionRDD [21055]<br>toJavaRDD at <unknown>:0"]; 21057 [labelType="html" label="PythonRDD [21057]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster47095 { label="MicroBatchScan"; 21043 [labelType="html" label="DataSourceRDD [21043]<br>run at <unknown>:0"]; 21044 [labelType="html" label="MapPartitionsRDD [21044]<br>run at <unknown>:0"]; } subgraph cluster47094 { label="Project"; 21045 [labelType="html" label="MapPartitionsRDD [21045]<br>run at <unknown>:0"]; } subgraph cluster47090 { label="WholeStageCodegen (1)"; 21046 [labelType="html" label="MapPartitionsRDD [21046]<br>run at <unknown>:0"]; } subgraph cluster47104 { label="WholeStageCodegen (1)"; 21048 [labelType="html" label="MapPartitionsRDD [21048]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47103 { label="Filter"; 21049 [labelType="html" label="MapPartitionsRDD [21049]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47102 { label="Project"; 21050 [labelType="html" label="MapPartitionsRDD [21050]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47099 { label="WholeStageCodegen (2)"; 21051 [labelType="html" label="MapPartitionsRDD [21051]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47098 { label="Project"; 21052 [labelType="html" label="MapPartitionsRDD [21052]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47097 { label="DeserializeToObject"; 21053 [labelType="html" label="MapPartitionsRDD [21053]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47096 { label="MapPartitions"; 21054 [labelType="html" label="MapPartitionsRDD [21054]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster47106 { label="mapPartitions"; 21056 [labelType="html" label="MapPartitionsRDD [21056]<br>toJavaRDD at <unknown>:0"]; } } 21043->21044; 21044->21045; 21045->21046; 21046->21047; 21047->21048; 21048->21049; 21049->21050; 21050->21051; 21051->21052; 21052->21053; 21053->21054; 21054->21055; 21055->21056; 21056->21057; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time