3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1699 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 496
Associated Job Ids:
1700
DAG Visualization
digraph G { subgraph clusterstage_1699 { label="Stage 1699"; 17855 [labelType="html" label="SQLExecutionRDD [17855]<br>run at <unknown>:0"]; 17863 [labelType="html" label="SQLExecutionRDD [17863]<br>toJavaRDD at <unknown>:0"]; 17865 [labelType="html" label="PythonRDD [17865]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39951 { label="MicroBatchScan"; 17851 [labelType="html" label="DataSourceRDD [17851]<br>run at <unknown>:0"]; 17852 [labelType="html" label="MapPartitionsRDD [17852]<br>run at <unknown>:0"]; } subgraph cluster39950 { label="Project"; 17853 [labelType="html" label="MapPartitionsRDD [17853]<br>run at <unknown>:0"]; } subgraph cluster39946 { label="WholeStageCodegen (1)"; 17854 [labelType="html" label="MapPartitionsRDD [17854]<br>run at <unknown>:0"]; } subgraph cluster39960 { label="WholeStageCodegen (1)"; 17856 [labelType="html" label="MapPartitionsRDD [17856]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39959 { label="Filter"; 17857 [labelType="html" label="MapPartitionsRDD [17857]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39958 { label="Project"; 17858 [labelType="html" label="MapPartitionsRDD [17858]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39955 { label="WholeStageCodegen (2)"; 17859 [labelType="html" label="MapPartitionsRDD [17859]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39954 { label="Project"; 17860 [labelType="html" label="MapPartitionsRDD [17860]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39953 { label="DeserializeToObject"; 17861 [labelType="html" label="MapPartitionsRDD [17861]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39952 { label="MapPartitions"; 17862 [labelType="html" label="MapPartitionsRDD [17862]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39962 { label="mapPartitions"; 17864 [labelType="html" label="MapPartitionsRDD [17864]<br>toJavaRDD at <unknown>:0"]; } } 17851->17852; 17852->17853; 17853->17854; 17854->17855; 17855->17856; 17856->17857; 17857->17858; 17858->17859; 17859->17860; 17860->17861; 17861->17862; 17862->17863; 17863->17864; 17864->17865; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time