3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1667 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 379
Associated Job Ids:
1668
DAG Visualization
digraph G { subgraph clusterstage_1667 { label="Stage 1667"; 17519 [labelType="html" label="SQLExecutionRDD [17519]<br>run at <unknown>:0"]; 17527 [labelType="html" label="SQLExecutionRDD [17527]<br>toJavaRDD at <unknown>:0"]; 17529 [labelType="html" label="PythonRDD [17529]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39199 { label="MicroBatchScan"; 17515 [labelType="html" label="DataSourceRDD [17515]<br>run at <unknown>:0"]; 17516 [labelType="html" label="MapPartitionsRDD [17516]<br>run at <unknown>:0"]; } subgraph cluster39198 { label="Project"; 17517 [labelType="html" label="MapPartitionsRDD [17517]<br>run at <unknown>:0"]; } subgraph cluster39194 { label="WholeStageCodegen (1)"; 17518 [labelType="html" label="MapPartitionsRDD [17518]<br>run at <unknown>:0"]; } subgraph cluster39208 { label="WholeStageCodegen (1)"; 17520 [labelType="html" label="MapPartitionsRDD [17520]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39207 { label="Filter"; 17521 [labelType="html" label="MapPartitionsRDD [17521]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39206 { label="Project"; 17522 [labelType="html" label="MapPartitionsRDD [17522]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39203 { label="WholeStageCodegen (2)"; 17523 [labelType="html" label="MapPartitionsRDD [17523]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39202 { label="Project"; 17524 [labelType="html" label="MapPartitionsRDD [17524]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39201 { label="DeserializeToObject"; 17525 [labelType="html" label="MapPartitionsRDD [17525]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39200 { label="MapPartitions"; 17526 [labelType="html" label="MapPartitionsRDD [17526]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39210 { label="mapPartitions"; 17528 [labelType="html" label="MapPartitionsRDD [17528]<br>toJavaRDD at <unknown>:0"]; } } 17515->17516; 17516->17517; 17517->17518; 17518->17519; 17519->17520; 17520->17521; 17521->17522; 17522->17523; 17523->17524; 17524->17525; 17525->17526; 17526->17527; 17527->17528; 17528->17529; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time