3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1318 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 460
Associated Job Ids:
1318
DAG Visualization
digraph G { subgraph clusterstage_1318 { label="Stage 1318"; 13843 [labelType="html" label="SQLExecutionRDD [13843]<br>run at <unknown>:0"]; 13851 [labelType="html" label="SQLExecutionRDD [13851]<br>toJavaRDD at <unknown>:0"]; 13853 [labelType="html" label="PythonRDD [13853]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster30978 { label="MicroBatchScan"; 13839 [labelType="html" label="DataSourceRDD [13839]<br>run at <unknown>:0"]; 13840 [labelType="html" label="MapPartitionsRDD [13840]<br>run at <unknown>:0"]; } subgraph cluster30977 { label="Project"; 13841 [labelType="html" label="MapPartitionsRDD [13841]<br>run at <unknown>:0"]; } subgraph cluster30973 { label="WholeStageCodegen (1)"; 13842 [labelType="html" label="MapPartitionsRDD [13842]<br>run at <unknown>:0"]; } subgraph cluster30987 { label="WholeStageCodegen (1)"; 13844 [labelType="html" label="MapPartitionsRDD [13844]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30986 { label="Filter"; 13845 [labelType="html" label="MapPartitionsRDD [13845]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30985 { label="Project"; 13846 [labelType="html" label="MapPartitionsRDD [13846]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30982 { label="WholeStageCodegen (2)"; 13847 [labelType="html" label="MapPartitionsRDD [13847]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30981 { label="Project"; 13848 [labelType="html" label="MapPartitionsRDD [13848]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30980 { label="DeserializeToObject"; 13849 [labelType="html" label="MapPartitionsRDD [13849]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30979 { label="MapPartitions"; 13850 [labelType="html" label="MapPartitionsRDD [13850]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster30989 { label="mapPartitions"; 13852 [labelType="html" label="MapPartitionsRDD [13852]<br>toJavaRDD at <unknown>:0"]; } } 13839->13840; 13840->13841; 13841->13842; 13842->13843; 13843->13844; 13844->13845; 13845->13846; 13846->13847; 13847->13848; 13848->13849; 13849->13850; 13850->13851; 13851->13852; 13852->13853; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time