3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1691 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 512
Associated Job Ids:
1692
DAG Visualization
digraph G { subgraph clusterstage_1691 { label="Stage 1691"; 17771 [labelType="html" label="SQLExecutionRDD [17771]<br>run at <unknown>:0"]; 17779 [labelType="html" label="SQLExecutionRDD [17779]<br>toJavaRDD at <unknown>:0"]; 17781 [labelType="html" label="PythonRDD [17781]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39763 { label="MicroBatchScan"; 17767 [labelType="html" label="DataSourceRDD [17767]<br>run at <unknown>:0"]; 17768 [labelType="html" label="MapPartitionsRDD [17768]<br>run at <unknown>:0"]; } subgraph cluster39762 { label="Project"; 17769 [labelType="html" label="MapPartitionsRDD [17769]<br>run at <unknown>:0"]; } subgraph cluster39758 { label="WholeStageCodegen (1)"; 17770 [labelType="html" label="MapPartitionsRDD [17770]<br>run at <unknown>:0"]; } subgraph cluster39772 { label="WholeStageCodegen (1)"; 17772 [labelType="html" label="MapPartitionsRDD [17772]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39771 { label="Filter"; 17773 [labelType="html" label="MapPartitionsRDD [17773]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39770 { label="Project"; 17774 [labelType="html" label="MapPartitionsRDD [17774]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39767 { label="WholeStageCodegen (2)"; 17775 [labelType="html" label="MapPartitionsRDD [17775]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39766 { label="Project"; 17776 [labelType="html" label="MapPartitionsRDD [17776]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39765 { label="DeserializeToObject"; 17777 [labelType="html" label="MapPartitionsRDD [17777]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39764 { label="MapPartitions"; 17778 [labelType="html" label="MapPartitionsRDD [17778]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39774 { label="mapPartitions"; 17780 [labelType="html" label="MapPartitionsRDD [17780]<br>toJavaRDD at <unknown>:0"]; } } 17767->17768; 17768->17769; 17769->17770; 17770->17771; 17771->17772; 17772->17773; 17773->17774; 17774->17775; 17775->17776; 17776->17777; 17777->17778; 17778->17779; 17779->17780; 17780->17781; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time