3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1994 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 404
Associated Job Ids:
1995
DAG Visualization
digraph G { subgraph clusterstage_1994 { label="Stage 1994"; 20942 [labelType="html" label="SQLExecutionRDD [20942]<br>run at <unknown>:0"]; 20956 [labelType="html" label="SQLExecutionRDD [20956]<br>toJavaRDD at <unknown>:0"]; 20958 [labelType="html" label="PythonRDD [20958]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster46860 { label="MicroBatchScan"; 20938 [labelType="html" label="DataSourceRDD [20938]<br>run at <unknown>:0"]; 20939 [labelType="html" label="MapPartitionsRDD [20939]<br>run at <unknown>:0"]; } subgraph cluster46859 { label="Project"; 20940 [labelType="html" label="MapPartitionsRDD [20940]<br>run at <unknown>:0"]; } subgraph cluster46855 { label="WholeStageCodegen (1)"; 20941 [labelType="html" label="MapPartitionsRDD [20941]<br>run at <unknown>:0"]; } subgraph cluster46877 { label="WholeStageCodegen (1)"; 20949 [labelType="html" label="MapPartitionsRDD [20949]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46876 { label="Filter"; 20950 [labelType="html" label="MapPartitionsRDD [20950]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46875 { label="Project"; 20951 [labelType="html" label="MapPartitionsRDD [20951]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46872 { label="WholeStageCodegen (2)"; 20952 [labelType="html" label="MapPartitionsRDD [20952]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46871 { label="Project"; 20953 [labelType="html" label="MapPartitionsRDD [20953]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46870 { label="DeserializeToObject"; 20954 [labelType="html" label="MapPartitionsRDD [20954]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46869 { label="MapPartitions"; 20955 [labelType="html" label="MapPartitionsRDD [20955]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster46879 { label="mapPartitions"; 20957 [labelType="html" label="MapPartitionsRDD [20957]<br>toJavaRDD at <unknown>:0"]; } } 20938->20939; 20939->20940; 20940->20941; 20941->20942; 20942->20949; 20949->20950; 20950->20951; 20951->20952; 20952->20953; 20953->20954; 20954->20955; 20955->20956; 20956->20957; 20957->20958; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time