3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1898 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 413
Associated Job Ids:
1898
DAG Visualization
digraph G { subgraph clusterstage_1898 { label="Stage 1898"; 19933 [labelType="html" label="SQLExecutionRDD [19933]<br>run at <unknown>:0"]; 19941 [labelType="html" label="SQLExecutionRDD [19941]<br>toJavaRDD at <unknown>:0"]; 19943 [labelType="html" label="PythonRDD [19943]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44608 { label="MicroBatchScan"; 19929 [labelType="html" label="DataSourceRDD [19929]<br>run at <unknown>:0"]; 19930 [labelType="html" label="MapPartitionsRDD [19930]<br>run at <unknown>:0"]; } subgraph cluster44607 { label="Project"; 19931 [labelType="html" label="MapPartitionsRDD [19931]<br>run at <unknown>:0"]; } subgraph cluster44603 { label="WholeStageCodegen (1)"; 19932 [labelType="html" label="MapPartitionsRDD [19932]<br>run at <unknown>:0"]; } subgraph cluster44617 { label="WholeStageCodegen (1)"; 19934 [labelType="html" label="MapPartitionsRDD [19934]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44616 { label="Filter"; 19935 [labelType="html" label="MapPartitionsRDD [19935]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44615 { label="Project"; 19936 [labelType="html" label="MapPartitionsRDD [19936]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44612 { label="WholeStageCodegen (2)"; 19937 [labelType="html" label="MapPartitionsRDD [19937]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44611 { label="Project"; 19938 [labelType="html" label="MapPartitionsRDD [19938]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44610 { label="DeserializeToObject"; 19939 [labelType="html" label="MapPartitionsRDD [19939]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44609 { label="MapPartitions"; 19940 [labelType="html" label="MapPartitionsRDD [19940]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44619 { label="mapPartitions"; 19942 [labelType="html" label="MapPartitionsRDD [19942]<br>toJavaRDD at <unknown>:0"]; } } 19929->19930; 19930->19931; 19931->19932; 19932->19933; 19933->19934; 19934->19935; 19935->19936; 19936->19937; 19937->19938; 19938->19939; 19939->19940; 19940->19941; 19941->19942; 19942->19943; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time