3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 151 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 498
Associated Job Ids:
151
DAG Visualization
digraph G { subgraph clusterstage_151 { label="Stage 151"; 1579 [labelType="html" label="SQLExecutionRDD [1579]<br>run at <unknown>:0"]; 1593 [labelType="html" label="SQLExecutionRDD [1593]<br>toJavaRDD at <unknown>:0"]; 1595 [labelType="html" label="PythonRDD [1595]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster3530 { label="MicroBatchScan"; 1575 [labelType="html" label="DataSourceRDD [1575]<br>run at <unknown>:0"]; 1576 [labelType="html" label="MapPartitionsRDD [1576]<br>run at <unknown>:0"]; } subgraph cluster3529 { label="Project"; 1577 [labelType="html" label="MapPartitionsRDD [1577]<br>run at <unknown>:0"]; } subgraph cluster3525 { label="WholeStageCodegen (1)"; 1578 [labelType="html" label="MapPartitionsRDD [1578]<br>run at <unknown>:0"]; } subgraph cluster3547 { label="WholeStageCodegen (1)"; 1586 [labelType="html" label="MapPartitionsRDD [1586]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3546 { label="Filter"; 1587 [labelType="html" label="MapPartitionsRDD [1587]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3545 { label="Project"; 1588 [labelType="html" label="MapPartitionsRDD [1588]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3542 { label="WholeStageCodegen (2)"; 1589 [labelType="html" label="MapPartitionsRDD [1589]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3541 { label="Project"; 1590 [labelType="html" label="MapPartitionsRDD [1590]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3540 { label="DeserializeToObject"; 1591 [labelType="html" label="MapPartitionsRDD [1591]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3539 { label="MapPartitions"; 1592 [labelType="html" label="MapPartitionsRDD [1592]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3549 { label="mapPartitions"; 1594 [labelType="html" label="MapPartitionsRDD [1594]<br>toJavaRDD at <unknown>:0"]; } } 1575->1576; 1576->1577; 1577->1578; 1578->1579; 1579->1586; 1586->1587; 1587->1588; 1588->1589; 1589->1590; 1590->1591; 1591->1592; 1592->1593; 1593->1594; 1594->1595; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time