3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 335 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 338
Associated Job Ids:
335
DAG Visualization
digraph G { subgraph clusterstage_335 { label="Stage 335"; 3511 [labelType="html" label="SQLExecutionRDD [3511]<br>run at <unknown>:0"]; 3525 [labelType="html" label="SQLExecutionRDD [3525]<br>toJavaRDD at <unknown>:0"]; 3527 [labelType="html" label="PythonRDD [3527]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7854 { label="MicroBatchScan"; 3507 [labelType="html" label="DataSourceRDD [3507]<br>run at <unknown>:0"]; 3508 [labelType="html" label="MapPartitionsRDD [3508]<br>run at <unknown>:0"]; } subgraph cluster7853 { label="Project"; 3509 [labelType="html" label="MapPartitionsRDD [3509]<br>run at <unknown>:0"]; } subgraph cluster7849 { label="WholeStageCodegen (1)"; 3510 [labelType="html" label="MapPartitionsRDD [3510]<br>run at <unknown>:0"]; } subgraph cluster7871 { label="WholeStageCodegen (1)"; 3518 [labelType="html" label="MapPartitionsRDD [3518]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7870 { label="Filter"; 3519 [labelType="html" label="MapPartitionsRDD [3519]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7869 { label="Project"; 3520 [labelType="html" label="MapPartitionsRDD [3520]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7866 { label="WholeStageCodegen (2)"; 3521 [labelType="html" label="MapPartitionsRDD [3521]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7865 { label="Project"; 3522 [labelType="html" label="MapPartitionsRDD [3522]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7864 { label="DeserializeToObject"; 3523 [labelType="html" label="MapPartitionsRDD [3523]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7863 { label="MapPartitions"; 3524 [labelType="html" label="MapPartitionsRDD [3524]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7873 { label="mapPartitions"; 3526 [labelType="html" label="MapPartitionsRDD [3526]<br>toJavaRDD at <unknown>:0"]; } } 3507->3508; 3508->3509; 3509->3510; 3510->3511; 3511->3518; 3518->3519; 3519->3520; 3520->3521; 3521->3522; 3522->3523; 3523->3524; 3524->3525; 3525->3526; 3526->3527; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time