3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 446 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 506
Associated Job Ids:
446
DAG Visualization
digraph G { subgraph clusterstage_446 { label="Stage 446"; 4687 [labelType="html" label="SQLExecutionRDD [4687]<br>run at <unknown>:0"]; 4695 [labelType="html" label="SQLExecutionRDD [4695]<br>toJavaRDD at <unknown>:0"]; 4697 [labelType="html" label="PythonRDD [4697]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10486 { label="MicroBatchScan"; 4683 [labelType="html" label="DataSourceRDD [4683]<br>run at <unknown>:0"]; 4684 [labelType="html" label="MapPartitionsRDD [4684]<br>run at <unknown>:0"]; } subgraph cluster10485 { label="Project"; 4685 [labelType="html" label="MapPartitionsRDD [4685]<br>run at <unknown>:0"]; } subgraph cluster10481 { label="WholeStageCodegen (1)"; 4686 [labelType="html" label="MapPartitionsRDD [4686]<br>run at <unknown>:0"]; } subgraph cluster10495 { label="WholeStageCodegen (1)"; 4688 [labelType="html" label="MapPartitionsRDD [4688]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10494 { label="Filter"; 4689 [labelType="html" label="MapPartitionsRDD [4689]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10493 { label="Project"; 4690 [labelType="html" label="MapPartitionsRDD [4690]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10490 { label="WholeStageCodegen (2)"; 4691 [labelType="html" label="MapPartitionsRDD [4691]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10489 { label="Project"; 4692 [labelType="html" label="MapPartitionsRDD [4692]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10488 { label="DeserializeToObject"; 4693 [labelType="html" label="MapPartitionsRDD [4693]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10487 { label="MapPartitions"; 4694 [labelType="html" label="MapPartitionsRDD [4694]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10497 { label="mapPartitions"; 4696 [labelType="html" label="MapPartitionsRDD [4696]<br>toJavaRDD at <unknown>:0"]; } } 4683->4684; 4684->4685; 4685->4686; 4686->4687; 4687->4688; 4688->4689; 4689->4690; 4690->4691; 4691->4692; 4692->4693; 4693->4694; 4694->4695; 4695->4696; 4696->4697; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time