3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 289 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 405
Associated Job Ids:
289
DAG Visualization
digraph G { subgraph clusterstage_289 { label="Stage 289"; 3028 [labelType="html" label="SQLExecutionRDD [3028]<br>run at <unknown>:0"]; 3042 [labelType="html" label="SQLExecutionRDD [3042]<br>toJavaRDD at <unknown>:0"]; 3044 [labelType="html" label="PythonRDD [3044]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6773 { label="MicroBatchScan"; 3024 [labelType="html" label="DataSourceRDD [3024]<br>run at <unknown>:0"]; 3025 [labelType="html" label="MapPartitionsRDD [3025]<br>run at <unknown>:0"]; } subgraph cluster6772 { label="Project"; 3026 [labelType="html" label="MapPartitionsRDD [3026]<br>run at <unknown>:0"]; } subgraph cluster6768 { label="WholeStageCodegen (1)"; 3027 [labelType="html" label="MapPartitionsRDD [3027]<br>run at <unknown>:0"]; } subgraph cluster6790 { label="WholeStageCodegen (1)"; 3035 [labelType="html" label="MapPartitionsRDD [3035]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6789 { label="Filter"; 3036 [labelType="html" label="MapPartitionsRDD [3036]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6788 { label="Project"; 3037 [labelType="html" label="MapPartitionsRDD [3037]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6785 { label="WholeStageCodegen (2)"; 3038 [labelType="html" label="MapPartitionsRDD [3038]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6784 { label="Project"; 3039 [labelType="html" label="MapPartitionsRDD [3039]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6783 { label="DeserializeToObject"; 3040 [labelType="html" label="MapPartitionsRDD [3040]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6782 { label="MapPartitions"; 3041 [labelType="html" label="MapPartitionsRDD [3041]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6792 { label="mapPartitions"; 3043 [labelType="html" label="MapPartitionsRDD [3043]<br>toJavaRDD at <unknown>:0"]; } } 3024->3025; 3025->3026; 3026->3027; 3027->3028; 3028->3035; 3035->3036; 3036->3037; 3037->3038; 3038->3039; 3039->3040; 3040->3041; 3041->3042; 3042->3043; 3043->3044; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time