3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 450 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 511
Associated Job Ids:
451
DAG Visualization
digraph G { subgraph clusterstage_450 { label="Stage 450"; 4730 [labelType="html" label="SQLExecutionRDD [4730]<br>run at <unknown>:0"]; 4744 [labelType="html" label="SQLExecutionRDD [4744]<br>toJavaRDD at <unknown>:0"]; 4746 [labelType="html" label="PythonRDD [4746]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10576 { label="MicroBatchScan"; 4726 [labelType="html" label="DataSourceRDD [4726]<br>run at <unknown>:0"]; 4727 [labelType="html" label="MapPartitionsRDD [4727]<br>run at <unknown>:0"]; } subgraph cluster10575 { label="Project"; 4728 [labelType="html" label="MapPartitionsRDD [4728]<br>run at <unknown>:0"]; } subgraph cluster10571 { label="WholeStageCodegen (1)"; 4729 [labelType="html" label="MapPartitionsRDD [4729]<br>run at <unknown>:0"]; } subgraph cluster10593 { label="WholeStageCodegen (1)"; 4737 [labelType="html" label="MapPartitionsRDD [4737]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10592 { label="Filter"; 4738 [labelType="html" label="MapPartitionsRDD [4738]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10591 { label="Project"; 4739 [labelType="html" label="MapPartitionsRDD [4739]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10588 { label="WholeStageCodegen (2)"; 4740 [labelType="html" label="MapPartitionsRDD [4740]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10587 { label="Project"; 4741 [labelType="html" label="MapPartitionsRDD [4741]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10586 { label="DeserializeToObject"; 4742 [labelType="html" label="MapPartitionsRDD [4742]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10585 { label="MapPartitions"; 4743 [labelType="html" label="MapPartitionsRDD [4743]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10595 { label="mapPartitions"; 4745 [labelType="html" label="MapPartitionsRDD [4745]<br>toJavaRDD at <unknown>:0"]; } } 4726->4727; 4727->4728; 4728->4729; 4729->4730; 4730->4737; 4737->4738; 4738->4739; 4739->4740; 4740->4741; 4741->4742; 4742->4743; 4743->4744; 4744->4745; 4745->4746; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time