3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 705 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 362
Associated Job Ids:
706
DAG Visualization
digraph G { subgraph clusterstage_705 { label="Stage 705"; 7418 [labelType="html" label="SQLExecutionRDD [7418]<br>run at <unknown>:0"]; 7426 [labelType="html" label="SQLExecutionRDD [7426]<br>toJavaRDD at <unknown>:0"]; 7428 [labelType="html" label="PythonRDD [7428]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16592 { label="MicroBatchScan"; 7414 [labelType="html" label="DataSourceRDD [7414]<br>run at <unknown>:0"]; 7415 [labelType="html" label="MapPartitionsRDD [7415]<br>run at <unknown>:0"]; } subgraph cluster16591 { label="Project"; 7416 [labelType="html" label="MapPartitionsRDD [7416]<br>run at <unknown>:0"]; } subgraph cluster16587 { label="WholeStageCodegen (1)"; 7417 [labelType="html" label="MapPartitionsRDD [7417]<br>run at <unknown>:0"]; } subgraph cluster16601 { label="WholeStageCodegen (1)"; 7419 [labelType="html" label="MapPartitionsRDD [7419]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16600 { label="Filter"; 7420 [labelType="html" label="MapPartitionsRDD [7420]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16599 { label="Project"; 7421 [labelType="html" label="MapPartitionsRDD [7421]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16596 { label="WholeStageCodegen (2)"; 7422 [labelType="html" label="MapPartitionsRDD [7422]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16595 { label="Project"; 7423 [labelType="html" label="MapPartitionsRDD [7423]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16594 { label="DeserializeToObject"; 7424 [labelType="html" label="MapPartitionsRDD [7424]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16593 { label="MapPartitions"; 7425 [labelType="html" label="MapPartitionsRDD [7425]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16603 { label="mapPartitions"; 7427 [labelType="html" label="MapPartitionsRDD [7427]<br>toJavaRDD at <unknown>:0"]; } } 7414->7415; 7415->7416; 7416->7417; 7417->7418; 7418->7419; 7419->7420; 7420->7421; 7421->7422; 7422->7423; 7423->7424; 7424->7425; 7425->7426; 7426->7427; 7427->7428; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time