3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 755 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 410
Associated Job Ids:
756
DAG Visualization
digraph G { subgraph clusterstage_755 { label="Stage 755"; 7943 [labelType="html" label="SQLExecutionRDD [7943]<br>run at <unknown>:0"]; 7951 [labelType="html" label="SQLExecutionRDD [7951]<br>toJavaRDD at <unknown>:0"]; 7953 [labelType="html" label="PythonRDD [7953]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17767 { label="MicroBatchScan"; 7939 [labelType="html" label="DataSourceRDD [7939]<br>run at <unknown>:0"]; 7940 [labelType="html" label="MapPartitionsRDD [7940]<br>run at <unknown>:0"]; } subgraph cluster17766 { label="Project"; 7941 [labelType="html" label="MapPartitionsRDD [7941]<br>run at <unknown>:0"]; } subgraph cluster17762 { label="WholeStageCodegen (1)"; 7942 [labelType="html" label="MapPartitionsRDD [7942]<br>run at <unknown>:0"]; } subgraph cluster17776 { label="WholeStageCodegen (1)"; 7944 [labelType="html" label="MapPartitionsRDD [7944]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17775 { label="Filter"; 7945 [labelType="html" label="MapPartitionsRDD [7945]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17774 { label="Project"; 7946 [labelType="html" label="MapPartitionsRDD [7946]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17771 { label="WholeStageCodegen (2)"; 7947 [labelType="html" label="MapPartitionsRDD [7947]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17770 { label="Project"; 7948 [labelType="html" label="MapPartitionsRDD [7948]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17769 { label="DeserializeToObject"; 7949 [labelType="html" label="MapPartitionsRDD [7949]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17768 { label="MapPartitions"; 7950 [labelType="html" label="MapPartitionsRDD [7950]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17778 { label="mapPartitions"; 7952 [labelType="html" label="MapPartitionsRDD [7952]<br>toJavaRDD at <unknown>:0"]; } } 7939->7940; 7940->7941; 7941->7942; 7942->7943; 7943->7944; 7944->7945; 7945->7946; 7946->7947; 7947->7948; 7948->7949; 7949->7950; 7950->7951; 7951->7952; 7952->7953; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time