3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 368 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 414
Associated Job Ids:
368
DAG Visualization
digraph G { subgraph clusterstage_368 { label="Stage 368"; 3868 [labelType="html" label="SQLExecutionRDD [3868]<br>run at <unknown>:0"]; 3876 [labelType="html" label="SQLExecutionRDD [3876]<br>toJavaRDD at <unknown>:0"]; 3878 [labelType="html" label="PythonRDD [3878]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8653 { label="MicroBatchScan"; 3864 [labelType="html" label="DataSourceRDD [3864]<br>run at <unknown>:0"]; 3865 [labelType="html" label="MapPartitionsRDD [3865]<br>run at <unknown>:0"]; } subgraph cluster8652 { label="Project"; 3866 [labelType="html" label="MapPartitionsRDD [3866]<br>run at <unknown>:0"]; } subgraph cluster8648 { label="WholeStageCodegen (1)"; 3867 [labelType="html" label="MapPartitionsRDD [3867]<br>run at <unknown>:0"]; } subgraph cluster8662 { label="WholeStageCodegen (1)"; 3869 [labelType="html" label="MapPartitionsRDD [3869]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8661 { label="Filter"; 3870 [labelType="html" label="MapPartitionsRDD [3870]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8660 { label="Project"; 3871 [labelType="html" label="MapPartitionsRDD [3871]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8657 { label="WholeStageCodegen (2)"; 3872 [labelType="html" label="MapPartitionsRDD [3872]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8656 { label="Project"; 3873 [labelType="html" label="MapPartitionsRDD [3873]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8655 { label="DeserializeToObject"; 3874 [labelType="html" label="MapPartitionsRDD [3874]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8654 { label="MapPartitions"; 3875 [labelType="html" label="MapPartitionsRDD [3875]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8664 { label="mapPartitions"; 3877 [labelType="html" label="MapPartitionsRDD [3877]<br>toJavaRDD at <unknown>:0"]; } } 3864->3865; 3865->3866; 3866->3867; 3867->3868; 3868->3869; 3869->3870; 3870->3871; 3871->3872; 3872->3873; 3873->3874; 3874->3875; 3875->3876; 3876->3877; 3877->3878; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time