3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 843 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 437
Associated Job Ids:
843
DAG Visualization
digraph G { subgraph clusterstage_843 { label="Stage 843"; 8851 [labelType="html" label="SQLExecutionRDD [8851]<br>run at <unknown>:0"]; 8859 [labelType="html" label="SQLExecutionRDD [8859]<br>toJavaRDD at <unknown>:0"]; 8861 [labelType="html" label="PythonRDD [8861]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19800 { label="MicroBatchScan"; 8847 [labelType="html" label="DataSourceRDD [8847]<br>run at <unknown>:0"]; 8848 [labelType="html" label="MapPartitionsRDD [8848]<br>run at <unknown>:0"]; } subgraph cluster19799 { label="Project"; 8849 [labelType="html" label="MapPartitionsRDD [8849]<br>run at <unknown>:0"]; } subgraph cluster19795 { label="WholeStageCodegen (1)"; 8850 [labelType="html" label="MapPartitionsRDD [8850]<br>run at <unknown>:0"]; } subgraph cluster19809 { label="WholeStageCodegen (1)"; 8852 [labelType="html" label="MapPartitionsRDD [8852]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19808 { label="Filter"; 8853 [labelType="html" label="MapPartitionsRDD [8853]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19807 { label="Project"; 8854 [labelType="html" label="MapPartitionsRDD [8854]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19804 { label="WholeStageCodegen (2)"; 8855 [labelType="html" label="MapPartitionsRDD [8855]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19803 { label="Project"; 8856 [labelType="html" label="MapPartitionsRDD [8856]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19802 { label="DeserializeToObject"; 8857 [labelType="html" label="MapPartitionsRDD [8857]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19801 { label="MapPartitions"; 8858 [labelType="html" label="MapPartitionsRDD [8858]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19811 { label="mapPartitions"; 8860 [labelType="html" label="MapPartitionsRDD [8860]<br>toJavaRDD at <unknown>:0"]; } } 8847->8848; 8848->8849; 8849->8850; 8850->8851; 8851->8852; 8852->8853; 8853->8854; 8854->8855; 8855->8856; 8856->8857; 8857->8858; 8858->8859; 8859->8860; 8860->8861; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time