3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 320 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 474
Associated Job Ids:
320
DAG Visualization
digraph G { subgraph clusterstage_320 { label="Stage 320"; 3364 [labelType="html" label="SQLExecutionRDD [3364]<br>run at <unknown>:0"]; 3372 [labelType="html" label="SQLExecutionRDD [3372]<br>toJavaRDD at <unknown>:0"]; 3374 [labelType="html" label="PythonRDD [3374]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster7525 { label="MicroBatchScan"; 3360 [labelType="html" label="DataSourceRDD [3360]<br>run at <unknown>:0"]; 3361 [labelType="html" label="MapPartitionsRDD [3361]<br>run at <unknown>:0"]; } subgraph cluster7524 { label="Project"; 3362 [labelType="html" label="MapPartitionsRDD [3362]<br>run at <unknown>:0"]; } subgraph cluster7520 { label="WholeStageCodegen (1)"; 3363 [labelType="html" label="MapPartitionsRDD [3363]<br>run at <unknown>:0"]; } subgraph cluster7534 { label="WholeStageCodegen (1)"; 3365 [labelType="html" label="MapPartitionsRDD [3365]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7533 { label="Filter"; 3366 [labelType="html" label="MapPartitionsRDD [3366]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7532 { label="Project"; 3367 [labelType="html" label="MapPartitionsRDD [3367]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7529 { label="WholeStageCodegen (2)"; 3368 [labelType="html" label="MapPartitionsRDD [3368]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7528 { label="Project"; 3369 [labelType="html" label="MapPartitionsRDD [3369]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7527 { label="DeserializeToObject"; 3370 [labelType="html" label="MapPartitionsRDD [3370]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7526 { label="MapPartitions"; 3371 [labelType="html" label="MapPartitionsRDD [3371]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster7536 { label="mapPartitions"; 3373 [labelType="html" label="MapPartitionsRDD [3373]<br>toJavaRDD at <unknown>:0"]; } } 3360->3361; 3361->3362; 3362->3363; 3363->3364; 3364->3365; 3365->3366; 3366->3367; 3367->3368; 3368->3369; 3369->3370; 3370->3371; 3371->3372; 3372->3373; 3373->3374; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time