3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 441 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 381
Associated Job Ids:
442
DAG Visualization
digraph G { subgraph clusterstage_441 { label="Stage 441"; 4646 [labelType="html" label="SQLExecutionRDD [4646]<br>run at <unknown>:0"]; 4654 [labelType="html" label="SQLExecutionRDD [4654]<br>toJavaRDD at <unknown>:0"]; 4656 [labelType="html" label="PythonRDD [4656]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10388 { label="MicroBatchScan"; 4642 [labelType="html" label="DataSourceRDD [4642]<br>run at <unknown>:0"]; 4643 [labelType="html" label="MapPartitionsRDD [4643]<br>run at <unknown>:0"]; } subgraph cluster10387 { label="Project"; 4644 [labelType="html" label="MapPartitionsRDD [4644]<br>run at <unknown>:0"]; } subgraph cluster10383 { label="WholeStageCodegen (1)"; 4645 [labelType="html" label="MapPartitionsRDD [4645]<br>run at <unknown>:0"]; } subgraph cluster10397 { label="WholeStageCodegen (1)"; 4647 [labelType="html" label="MapPartitionsRDD [4647]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10396 { label="Filter"; 4648 [labelType="html" label="MapPartitionsRDD [4648]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10395 { label="Project"; 4649 [labelType="html" label="MapPartitionsRDD [4649]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10392 { label="WholeStageCodegen (2)"; 4650 [labelType="html" label="MapPartitionsRDD [4650]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10391 { label="Project"; 4651 [labelType="html" label="MapPartitionsRDD [4651]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10390 { label="DeserializeToObject"; 4652 [labelType="html" label="MapPartitionsRDD [4652]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10389 { label="MapPartitions"; 4653 [labelType="html" label="MapPartitionsRDD [4653]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10399 { label="mapPartitions"; 4655 [labelType="html" label="MapPartitionsRDD [4655]<br>toJavaRDD at <unknown>:0"]; } } 4642->4643; 4643->4644; 4644->4645; 4645->4646; 4646->4647; 4647->4648; 4648->4649; 4649->4650; 4650->4651; 4651->4652; 4652->4653; 4653->4654; 4654->4655; 4655->4656; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time