3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 79 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 436
Associated Job Ids:
79
DAG Visualization
digraph G { subgraph clusterstage_79 { label="Stage 79"; 823 [labelType="html" label="SQLExecutionRDD [823]<br>run at <unknown>:0"]; 837 [labelType="html" label="SQLExecutionRDD [837]<br>toJavaRDD at <unknown>:0"]; 839 [labelType="html" label="PythonRDD [839]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster1838 { label="MicroBatchScan"; 819 [labelType="html" label="DataSourceRDD [819]<br>run at <unknown>:0"]; 820 [labelType="html" label="MapPartitionsRDD [820]<br>run at <unknown>:0"]; } subgraph cluster1837 { label="Project"; 821 [labelType="html" label="MapPartitionsRDD [821]<br>run at <unknown>:0"]; } subgraph cluster1833 { label="WholeStageCodegen (1)"; 822 [labelType="html" label="MapPartitionsRDD [822]<br>run at <unknown>:0"]; } subgraph cluster1855 { label="WholeStageCodegen (1)"; 830 [labelType="html" label="MapPartitionsRDD [830]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1854 { label="Filter"; 831 [labelType="html" label="MapPartitionsRDD [831]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1853 { label="Project"; 832 [labelType="html" label="MapPartitionsRDD [832]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1850 { label="WholeStageCodegen (2)"; 833 [labelType="html" label="MapPartitionsRDD [833]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1849 { label="Project"; 834 [labelType="html" label="MapPartitionsRDD [834]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1848 { label="DeserializeToObject"; 835 [labelType="html" label="MapPartitionsRDD [835]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1847 { label="MapPartitions"; 836 [labelType="html" label="MapPartitionsRDD [836]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1857 { label="mapPartitions"; 838 [labelType="html" label="MapPartitionsRDD [838]<br>toJavaRDD at <unknown>:0"]; } } 819->820; 820->821; 821->822; 822->823; 823->830; 830->831; 831->832; 832->833; 833->834; 834->835; 835->836; 836->837; 837->838; 838->839; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time