3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 35 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 406
Associated Job Ids:
35
DAG Visualization
digraph G { subgraph clusterstage_35 { label="Stage 35"; 361 [labelType="html" label="SQLExecutionRDD [361]<br>run at <unknown>:0"]; 375 [labelType="html" label="SQLExecutionRDD [375]<br>toJavaRDD at <unknown>:0"]; 377 [labelType="html" label="PythonRDD [377]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster804 { label="MicroBatchScan"; 357 [labelType="html" label="DataSourceRDD [357]<br>run at <unknown>:0"]; 358 [labelType="html" label="MapPartitionsRDD [358]<br>run at <unknown>:0"]; } subgraph cluster803 { label="Project"; 359 [labelType="html" label="MapPartitionsRDD [359]<br>run at <unknown>:0"]; } subgraph cluster799 { label="WholeStageCodegen (1)"; 360 [labelType="html" label="MapPartitionsRDD [360]<br>run at <unknown>:0"]; } subgraph cluster821 { label="WholeStageCodegen (1)"; 368 [labelType="html" label="MapPartitionsRDD [368]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster820 { label="Filter"; 369 [labelType="html" label="MapPartitionsRDD [369]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster819 { label="Project"; 370 [labelType="html" label="MapPartitionsRDD [370]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster816 { label="WholeStageCodegen (2)"; 371 [labelType="html" label="MapPartitionsRDD [371]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster815 { label="Project"; 372 [labelType="html" label="MapPartitionsRDD [372]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster814 { label="DeserializeToObject"; 373 [labelType="html" label="MapPartitionsRDD [373]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster813 { label="MapPartitions"; 374 [labelType="html" label="MapPartitionsRDD [374]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster823 { label="mapPartitions"; 376 [labelType="html" label="MapPartitionsRDD [376]<br>toJavaRDD at <unknown>:0"]; } } 357->358; 358->359; 359->360; 360->361; 361->368; 368->369; 369->370; 370->371; 371->372; 372->373; 373->374; 374->375; 375->376; 376->377; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time