3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1470 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 583
Associated Job Ids:
1470
DAG Visualization
digraph G { subgraph clusterstage_1470 { label="Stage 1470"; 15439 [labelType="html" label="SQLExecutionRDD [15439]<br>run at <unknown>:0"]; 15447 [labelType="html" label="SQLExecutionRDD [15447]<br>toJavaRDD at <unknown>:0"]; 15449 [labelType="html" label="PythonRDD [15449]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster34550 { label="MicroBatchScan"; 15435 [labelType="html" label="DataSourceRDD [15435]<br>run at <unknown>:0"]; 15436 [labelType="html" label="MapPartitionsRDD [15436]<br>run at <unknown>:0"]; } subgraph cluster34549 { label="Project"; 15437 [labelType="html" label="MapPartitionsRDD [15437]<br>run at <unknown>:0"]; } subgraph cluster34545 { label="WholeStageCodegen (1)"; 15438 [labelType="html" label="MapPartitionsRDD [15438]<br>run at <unknown>:0"]; } subgraph cluster34559 { label="WholeStageCodegen (1)"; 15440 [labelType="html" label="MapPartitionsRDD [15440]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34558 { label="Filter"; 15441 [labelType="html" label="MapPartitionsRDD [15441]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34557 { label="Project"; 15442 [labelType="html" label="MapPartitionsRDD [15442]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34554 { label="WholeStageCodegen (2)"; 15443 [labelType="html" label="MapPartitionsRDD [15443]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34553 { label="Project"; 15444 [labelType="html" label="MapPartitionsRDD [15444]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34552 { label="DeserializeToObject"; 15445 [labelType="html" label="MapPartitionsRDD [15445]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34551 { label="MapPartitions"; 15446 [labelType="html" label="MapPartitionsRDD [15446]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster34561 { label="mapPartitions"; 15448 [labelType="html" label="MapPartitionsRDD [15448]<br>toJavaRDD at <unknown>:0"]; } } 15435->15436; 15436->15437; 15437->15438; 15438->15439; 15439->15440; 15440->15441; 15441->15442; 15442->15443; 15443->15444; 15444->15445; 15445->15446; 15446->15447; 15447->15448; 15448->15449; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time