3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 556 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 465
Associated Job Ids:
556
DAG Visualization
digraph G { subgraph clusterstage_556 { label="Stage 556"; 5842 [labelType="html" label="SQLExecutionRDD [5842]<br>run at <unknown>:0"]; 5850 [labelType="html" label="SQLExecutionRDD [5850]<br>toJavaRDD at <unknown>:0"]; 5852 [labelType="html" label="PythonRDD [5852]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster13071 { label="MicroBatchScan"; 5838 [labelType="html" label="DataSourceRDD [5838]<br>run at <unknown>:0"]; 5839 [labelType="html" label="MapPartitionsRDD [5839]<br>run at <unknown>:0"]; } subgraph cluster13070 { label="Project"; 5840 [labelType="html" label="MapPartitionsRDD [5840]<br>run at <unknown>:0"]; } subgraph cluster13066 { label="WholeStageCodegen (1)"; 5841 [labelType="html" label="MapPartitionsRDD [5841]<br>run at <unknown>:0"]; } subgraph cluster13080 { label="WholeStageCodegen (1)"; 5843 [labelType="html" label="MapPartitionsRDD [5843]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13079 { label="Filter"; 5844 [labelType="html" label="MapPartitionsRDD [5844]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13078 { label="Project"; 5845 [labelType="html" label="MapPartitionsRDD [5845]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13075 { label="WholeStageCodegen (2)"; 5846 [labelType="html" label="MapPartitionsRDD [5846]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13074 { label="Project"; 5847 [labelType="html" label="MapPartitionsRDD [5847]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13073 { label="DeserializeToObject"; 5848 [labelType="html" label="MapPartitionsRDD [5848]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13072 { label="MapPartitions"; 5849 [labelType="html" label="MapPartitionsRDD [5849]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster13082 { label="mapPartitions"; 5851 [labelType="html" label="MapPartitionsRDD [5851]<br>toJavaRDD at <unknown>:0"]; } } 5838->5839; 5839->5840; 5840->5841; 5841->5842; 5842->5843; 5843->5844; 5844->5845; 5845->5846; 5846->5847; 5847->5848; 5848->5849; 5849->5850; 5850->5851; 5851->5852; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time