3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 973 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 481
Associated Job Ids:
974
DAG Visualization
digraph G { subgraph clusterstage_973 { label="Stage 973"; 10232 [labelType="html" label="SQLExecutionRDD [10232]<br>run at <unknown>:0"]; 10240 [labelType="html" label="SQLExecutionRDD [10240]<br>toJavaRDD at <unknown>:0"]; 10242 [labelType="html" label="PythonRDD [10242]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster22890 { label="MicroBatchScan"; 10228 [labelType="html" label="DataSourceRDD [10228]<br>run at <unknown>:0"]; 10229 [labelType="html" label="MapPartitionsRDD [10229]<br>run at <unknown>:0"]; } subgraph cluster22889 { label="Project"; 10230 [labelType="html" label="MapPartitionsRDD [10230]<br>run at <unknown>:0"]; } subgraph cluster22885 { label="WholeStageCodegen (1)"; 10231 [labelType="html" label="MapPartitionsRDD [10231]<br>run at <unknown>:0"]; } subgraph cluster22899 { label="WholeStageCodegen (1)"; 10233 [labelType="html" label="MapPartitionsRDD [10233]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22898 { label="Filter"; 10234 [labelType="html" label="MapPartitionsRDD [10234]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22897 { label="Project"; 10235 [labelType="html" label="MapPartitionsRDD [10235]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22894 { label="WholeStageCodegen (2)"; 10236 [labelType="html" label="MapPartitionsRDD [10236]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22893 { label="Project"; 10237 [labelType="html" label="MapPartitionsRDD [10237]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22892 { label="DeserializeToObject"; 10238 [labelType="html" label="MapPartitionsRDD [10238]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22891 { label="MapPartitions"; 10239 [labelType="html" label="MapPartitionsRDD [10239]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22901 { label="mapPartitions"; 10241 [labelType="html" label="MapPartitionsRDD [10241]<br>toJavaRDD at <unknown>:0"]; } } 10228->10229; 10229->10230; 10230->10231; 10231->10232; 10232->10233; 10233->10234; 10234->10235; 10235->10236; 10236->10237; 10237->10238; 10238->10239; 10239->10240; 10240->10241; 10241->10242; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time