3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 834 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 462
Associated Job Ids:
834
DAG Visualization
digraph G { subgraph clusterstage_834 { label="Stage 834"; 8761 [labelType="html" label="SQLExecutionRDD [8761]<br>run at <unknown>:0"]; 8769 [labelType="html" label="SQLExecutionRDD [8769]<br>toJavaRDD at <unknown>:0"]; 8771 [labelType="html" label="PythonRDD [8771]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19604 { label="MicroBatchScan"; 8757 [labelType="html" label="DataSourceRDD [8757]<br>run at <unknown>:0"]; 8758 [labelType="html" label="MapPartitionsRDD [8758]<br>run at <unknown>:0"]; } subgraph cluster19603 { label="Project"; 8759 [labelType="html" label="MapPartitionsRDD [8759]<br>run at <unknown>:0"]; } subgraph cluster19599 { label="WholeStageCodegen (1)"; 8760 [labelType="html" label="MapPartitionsRDD [8760]<br>run at <unknown>:0"]; } subgraph cluster19613 { label="WholeStageCodegen (1)"; 8762 [labelType="html" label="MapPartitionsRDD [8762]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19612 { label="Filter"; 8763 [labelType="html" label="MapPartitionsRDD [8763]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19611 { label="Project"; 8764 [labelType="html" label="MapPartitionsRDD [8764]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19608 { label="WholeStageCodegen (2)"; 8765 [labelType="html" label="MapPartitionsRDD [8765]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19607 { label="Project"; 8766 [labelType="html" label="MapPartitionsRDD [8766]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19606 { label="DeserializeToObject"; 8767 [labelType="html" label="MapPartitionsRDD [8767]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19605 { label="MapPartitions"; 8768 [labelType="html" label="MapPartitionsRDD [8768]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19615 { label="mapPartitions"; 8770 [labelType="html" label="MapPartitionsRDD [8770]<br>toJavaRDD at <unknown>:0"]; } } 8757->8758; 8758->8759; 8759->8760; 8760->8761; 8761->8762; 8762->8763; 8763->8764; 8764->8765; 8765->8766; 8766->8767; 8767->8768; 8768->8769; 8769->8770; 8770->8771; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time