3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1697 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 342
Associated Job Ids:
1698
DAG Visualization
digraph G { subgraph clusterstage_1697 { label="Stage 1697"; 17834 [labelType="html" label="SQLExecutionRDD [17834]<br>run at <unknown>:0"]; 17842 [labelType="html" label="SQLExecutionRDD [17842]<br>toJavaRDD at <unknown>:0"]; 17844 [labelType="html" label="PythonRDD [17844]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster39904 { label="MicroBatchScan"; 17830 [labelType="html" label="DataSourceRDD [17830]<br>run at <unknown>:0"]; 17831 [labelType="html" label="MapPartitionsRDD [17831]<br>run at <unknown>:0"]; } subgraph cluster39903 { label="Project"; 17832 [labelType="html" label="MapPartitionsRDD [17832]<br>run at <unknown>:0"]; } subgraph cluster39899 { label="WholeStageCodegen (1)"; 17833 [labelType="html" label="MapPartitionsRDD [17833]<br>run at <unknown>:0"]; } subgraph cluster39913 { label="WholeStageCodegen (1)"; 17835 [labelType="html" label="MapPartitionsRDD [17835]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39912 { label="Filter"; 17836 [labelType="html" label="MapPartitionsRDD [17836]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39911 { label="Project"; 17837 [labelType="html" label="MapPartitionsRDD [17837]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39908 { label="WholeStageCodegen (2)"; 17838 [labelType="html" label="MapPartitionsRDD [17838]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39907 { label="Project"; 17839 [labelType="html" label="MapPartitionsRDD [17839]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39906 { label="DeserializeToObject"; 17840 [labelType="html" label="MapPartitionsRDD [17840]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39905 { label="MapPartitions"; 17841 [labelType="html" label="MapPartitionsRDD [17841]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster39915 { label="mapPartitions"; 17843 [labelType="html" label="MapPartitionsRDD [17843]<br>toJavaRDD at <unknown>:0"]; } } 17830->17831; 17831->17832; 17832->17833; 17833->17834; 17834->17835; 17835->17836; 17836->17837; 17837->17838; 17838->17839; 17839->17840; 17840->17841; 17841->17842; 17842->17843; 17843->17844; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time