3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 733 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 448
Associated Job Ids:
734
DAG Visualization
digraph G { subgraph clusterstage_733 { label="Stage 733"; 7712 [labelType="html" label="SQLExecutionRDD [7712]<br>run at <unknown>:0"]; 7720 [labelType="html" label="SQLExecutionRDD [7720]<br>toJavaRDD at <unknown>:0"]; 7722 [labelType="html" label="PythonRDD [7722]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17250 { label="MicroBatchScan"; 7708 [labelType="html" label="DataSourceRDD [7708]<br>run at <unknown>:0"]; 7709 [labelType="html" label="MapPartitionsRDD [7709]<br>run at <unknown>:0"]; } subgraph cluster17249 { label="Project"; 7710 [labelType="html" label="MapPartitionsRDD [7710]<br>run at <unknown>:0"]; } subgraph cluster17245 { label="WholeStageCodegen (1)"; 7711 [labelType="html" label="MapPartitionsRDD [7711]<br>run at <unknown>:0"]; } subgraph cluster17259 { label="WholeStageCodegen (1)"; 7713 [labelType="html" label="MapPartitionsRDD [7713]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17258 { label="Filter"; 7714 [labelType="html" label="MapPartitionsRDD [7714]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17257 { label="Project"; 7715 [labelType="html" label="MapPartitionsRDD [7715]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17254 { label="WholeStageCodegen (2)"; 7716 [labelType="html" label="MapPartitionsRDD [7716]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17253 { label="Project"; 7717 [labelType="html" label="MapPartitionsRDD [7717]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17252 { label="DeserializeToObject"; 7718 [labelType="html" label="MapPartitionsRDD [7718]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17251 { label="MapPartitions"; 7719 [labelType="html" label="MapPartitionsRDD [7719]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17261 { label="mapPartitions"; 7721 [labelType="html" label="MapPartitionsRDD [7721]<br>toJavaRDD at <unknown>:0"]; } } 7708->7709; 7709->7710; 7710->7711; 7711->7712; 7712->7713; 7713->7714; 7714->7715; 7715->7716; 7716->7717; 7717->7718; 7718->7719; 7719->7720; 7720->7721; 7721->7722; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time