3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1397 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 496
Associated Job Ids:
1398
DAG Visualization
digraph G { subgraph clusterstage_1397 { label="Stage 1397"; 14684 [labelType="html" label="SQLExecutionRDD [14684]<br>run at <unknown>:0"]; 14692 [labelType="html" label="SQLExecutionRDD [14692]<br>toJavaRDD at <unknown>:0"]; 14694 [labelType="html" label="PythonRDD [14694]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32854 { label="MicroBatchScan"; 14680 [labelType="html" label="DataSourceRDD [14680]<br>run at <unknown>:0"]; 14681 [labelType="html" label="MapPartitionsRDD [14681]<br>run at <unknown>:0"]; } subgraph cluster32853 { label="Project"; 14682 [labelType="html" label="MapPartitionsRDD [14682]<br>run at <unknown>:0"]; } subgraph cluster32849 { label="WholeStageCodegen (1)"; 14683 [labelType="html" label="MapPartitionsRDD [14683]<br>run at <unknown>:0"]; } subgraph cluster32863 { label="WholeStageCodegen (1)"; 14685 [labelType="html" label="MapPartitionsRDD [14685]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32862 { label="Filter"; 14686 [labelType="html" label="MapPartitionsRDD [14686]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32861 { label="Project"; 14687 [labelType="html" label="MapPartitionsRDD [14687]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32858 { label="WholeStageCodegen (2)"; 14688 [labelType="html" label="MapPartitionsRDD [14688]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32857 { label="Project"; 14689 [labelType="html" label="MapPartitionsRDD [14689]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32856 { label="DeserializeToObject"; 14690 [labelType="html" label="MapPartitionsRDD [14690]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32855 { label="MapPartitions"; 14691 [labelType="html" label="MapPartitionsRDD [14691]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32865 { label="mapPartitions"; 14693 [labelType="html" label="MapPartitionsRDD [14693]<br>toJavaRDD at <unknown>:0"]; } } 14680->14681; 14681->14682; 14682->14683; 14683->14684; 14684->14685; 14685->14686; 14686->14687; 14687->14688; 14688->14689; 14689->14690; 14690->14691; 14691->14692; 14692->14693; 14693->14694; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time