3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 373 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 427
Associated Job Ids:
373
DAG Visualization
digraph G { subgraph clusterstage_373 { label="Stage 373"; 3910 [labelType="html" label="SQLExecutionRDD [3910]<br>run at <unknown>:0"]; 3924 [labelType="html" label="SQLExecutionRDD [3924]<br>toJavaRDD at <unknown>:0"]; 3926 [labelType="html" label="PythonRDD [3926]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8747 { label="MicroBatchScan"; 3906 [labelType="html" label="DataSourceRDD [3906]<br>run at <unknown>:0"]; 3907 [labelType="html" label="MapPartitionsRDD [3907]<br>run at <unknown>:0"]; } subgraph cluster8746 { label="Project"; 3908 [labelType="html" label="MapPartitionsRDD [3908]<br>run at <unknown>:0"]; } subgraph cluster8742 { label="WholeStageCodegen (1)"; 3909 [labelType="html" label="MapPartitionsRDD [3909]<br>run at <unknown>:0"]; } subgraph cluster8764 { label="WholeStageCodegen (1)"; 3917 [labelType="html" label="MapPartitionsRDD [3917]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8763 { label="Filter"; 3918 [labelType="html" label="MapPartitionsRDD [3918]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8762 { label="Project"; 3919 [labelType="html" label="MapPartitionsRDD [3919]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8759 { label="WholeStageCodegen (2)"; 3920 [labelType="html" label="MapPartitionsRDD [3920]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8758 { label="Project"; 3921 [labelType="html" label="MapPartitionsRDD [3921]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8757 { label="DeserializeToObject"; 3922 [labelType="html" label="MapPartitionsRDD [3922]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8756 { label="MapPartitions"; 3923 [labelType="html" label="MapPartitionsRDD [3923]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8766 { label="mapPartitions"; 3925 [labelType="html" label="MapPartitionsRDD [3925]<br>toJavaRDD at <unknown>:0"]; } } 3906->3907; 3907->3908; 3908->3909; 3909->3910; 3910->3917; 3917->3918; 3918->3919; 3919->3920; 3920->3921; 3921->3922; 3922->3923; 3923->3924; 3924->3925; 3925->3926; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time