3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 671 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 505
Associated Job Ids:
672
DAG Visualization
digraph G { subgraph clusterstage_671 { label="Stage 671"; 7061 [labelType="html" label="SQLExecutionRDD [7061]<br>run at <unknown>:0"]; 7069 [labelType="html" label="SQLExecutionRDD [7069]<br>toJavaRDD at <unknown>:0"]; 7071 [labelType="html" label="PythonRDD [7071]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster15793 { label="MicroBatchScan"; 7057 [labelType="html" label="DataSourceRDD [7057]<br>run at <unknown>:0"]; 7058 [labelType="html" label="MapPartitionsRDD [7058]<br>run at <unknown>:0"]; } subgraph cluster15792 { label="Project"; 7059 [labelType="html" label="MapPartitionsRDD [7059]<br>run at <unknown>:0"]; } subgraph cluster15788 { label="WholeStageCodegen (1)"; 7060 [labelType="html" label="MapPartitionsRDD [7060]<br>run at <unknown>:0"]; } subgraph cluster15802 { label="WholeStageCodegen (1)"; 7062 [labelType="html" label="MapPartitionsRDD [7062]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15801 { label="Filter"; 7063 [labelType="html" label="MapPartitionsRDD [7063]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15800 { label="Project"; 7064 [labelType="html" label="MapPartitionsRDD [7064]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15797 { label="WholeStageCodegen (2)"; 7065 [labelType="html" label="MapPartitionsRDD [7065]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15796 { label="Project"; 7066 [labelType="html" label="MapPartitionsRDD [7066]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15795 { label="DeserializeToObject"; 7067 [labelType="html" label="MapPartitionsRDD [7067]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15794 { label="MapPartitions"; 7068 [labelType="html" label="MapPartitionsRDD [7068]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15804 { label="mapPartitions"; 7070 [labelType="html" label="MapPartitionsRDD [7070]<br>toJavaRDD at <unknown>:0"]; } } 7057->7058; 7058->7059; 7059->7060; 7060->7061; 7061->7062; 7062->7063; 7063->7064; 7064->7065; 7065->7066; 7066->7067; 7067->7068; 7068->7069; 7069->7070; 7070->7071; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time