3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1391 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 453
Associated Job Ids:
1392
DAG Visualization
digraph G { subgraph clusterstage_1391 { label="Stage 1391"; 14621 [labelType="html" label="SQLExecutionRDD [14621]<br>run at <unknown>:0"]; 14629 [labelType="html" label="SQLExecutionRDD [14629]<br>toJavaRDD at <unknown>:0"]; 14631 [labelType="html" label="PythonRDD [14631]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32713 { label="MicroBatchScan"; 14617 [labelType="html" label="DataSourceRDD [14617]<br>run at <unknown>:0"]; 14618 [labelType="html" label="MapPartitionsRDD [14618]<br>run at <unknown>:0"]; } subgraph cluster32712 { label="Project"; 14619 [labelType="html" label="MapPartitionsRDD [14619]<br>run at <unknown>:0"]; } subgraph cluster32708 { label="WholeStageCodegen (1)"; 14620 [labelType="html" label="MapPartitionsRDD [14620]<br>run at <unknown>:0"]; } subgraph cluster32722 { label="WholeStageCodegen (1)"; 14622 [labelType="html" label="MapPartitionsRDD [14622]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32721 { label="Filter"; 14623 [labelType="html" label="MapPartitionsRDD [14623]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32720 { label="Project"; 14624 [labelType="html" label="MapPartitionsRDD [14624]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32717 { label="WholeStageCodegen (2)"; 14625 [labelType="html" label="MapPartitionsRDD [14625]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32716 { label="Project"; 14626 [labelType="html" label="MapPartitionsRDD [14626]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32715 { label="DeserializeToObject"; 14627 [labelType="html" label="MapPartitionsRDD [14627]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32714 { label="MapPartitions"; 14628 [labelType="html" label="MapPartitionsRDD [14628]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32724 { label="mapPartitions"; 14630 [labelType="html" label="MapPartitionsRDD [14630]<br>toJavaRDD at <unknown>:0"]; } } 14617->14618; 14618->14619; 14619->14620; 14620->14621; 14621->14622; 14622->14623; 14623->14624; 14624->14625; 14625->14626; 14626->14627; 14627->14628; 14628->14629; 14629->14630; 14630->14631; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time