3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1995 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 458
Associated Job Ids:
1996
DAG Visualization
digraph G { subgraph clusterstage_1995 { label="Stage 1995"; 20963 [labelType="html" label="SQLExecutionRDD [20963]<br>run at <unknown>:0"]; 20971 [labelType="html" label="SQLExecutionRDD [20971]<br>toJavaRDD at <unknown>:0"]; 20973 [labelType="html" label="PythonRDD [20973]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster46907 { label="MicroBatchScan"; 20959 [labelType="html" label="DataSourceRDD [20959]<br>run at <unknown>:0"]; 20960 [labelType="html" label="MapPartitionsRDD [20960]<br>run at <unknown>:0"]; } subgraph cluster46906 { label="Project"; 20961 [labelType="html" label="MapPartitionsRDD [20961]<br>run at <unknown>:0"]; } subgraph cluster46902 { label="WholeStageCodegen (1)"; 20962 [labelType="html" label="MapPartitionsRDD [20962]<br>run at <unknown>:0"]; } subgraph cluster46916 { label="WholeStageCodegen (1)"; 20964 [labelType="html" label="MapPartitionsRDD [20964]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46915 { label="Filter"; 20965 [labelType="html" label="MapPartitionsRDD [20965]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46914 { label="Project"; 20966 [labelType="html" label="MapPartitionsRDD [20966]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46911 { label="WholeStageCodegen (2)"; 20967 [labelType="html" label="MapPartitionsRDD [20967]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46910 { label="Project"; 20968 [labelType="html" label="MapPartitionsRDD [20968]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46909 { label="DeserializeToObject"; 20969 [labelType="html" label="MapPartitionsRDD [20969]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46908 { label="MapPartitions"; 20970 [labelType="html" label="MapPartitionsRDD [20970]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46918 { label="mapPartitions"; 20972 [labelType="html" label="MapPartitionsRDD [20972]<br>toJavaRDD at <unknown>:0"]; } } 20959->20960; 20960->20961; 20961->20962; 20962->20963; 20963->20964; 20964->20965; 20965->20966; 20966->20967; 20967->20968; 20968->20969; 20969->20970; 20970->20971; 20971->20972; 20972->20973; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time