3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 383 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 474
Associated Job Ids:
383
DAG Visualization
digraph G { subgraph clusterstage_383 { label="Stage 383"; 4021 [labelType="html" label="SQLExecutionRDD [4021]<br>run at <unknown>:0"]; 4029 [labelType="html" label="SQLExecutionRDD [4029]<br>toJavaRDD at <unknown>:0"]; 4031 [labelType="html" label="PythonRDD [4031]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8990 { label="MicroBatchScan"; 4012 [labelType="html" label="DataSourceRDD [4012]<br>run at <unknown>:0"]; 4015 [labelType="html" label="MapPartitionsRDD [4015]<br>run at <unknown>:0"]; } subgraph cluster8989 { label="Project"; 4016 [labelType="html" label="MapPartitionsRDD [4016]<br>run at <unknown>:0"]; } subgraph cluster8983 { label="WholeStageCodegen (1)"; 4020 [labelType="html" label="MapPartitionsRDD [4020]<br>run at <unknown>:0"]; } subgraph cluster8999 { label="WholeStageCodegen (1)"; 4022 [labelType="html" label="MapPartitionsRDD [4022]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8998 { label="Filter"; 4023 [labelType="html" label="MapPartitionsRDD [4023]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8997 { label="Project"; 4024 [labelType="html" label="MapPartitionsRDD [4024]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8994 { label="WholeStageCodegen (2)"; 4025 [labelType="html" label="MapPartitionsRDD [4025]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8993 { label="Project"; 4026 [labelType="html" label="MapPartitionsRDD [4026]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8992 { label="DeserializeToObject"; 4027 [labelType="html" label="MapPartitionsRDD [4027]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8991 { label="MapPartitions"; 4028 [labelType="html" label="MapPartitionsRDD [4028]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster9001 { label="mapPartitions"; 4030 [labelType="html" label="MapPartitionsRDD [4030]<br>toJavaRDD at <unknown>:0"]; } } 4012->4015; 4015->4016; 4016->4020; 4020->4021; 4021->4022; 4022->4023; 4023->4024; 4024->4025; 4025->4026; 4026->4027; 4027->4028; 4028->4029; 4029->4030; 4030->4031; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time