3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 725 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 265
Associated Job Ids:
726
DAG Visualization
digraph G { subgraph clusterstage_725 { label="Stage 725"; 7628 [labelType="html" label="SQLExecutionRDD [7628]<br>run at <unknown>:0"]; 7636 [labelType="html" label="SQLExecutionRDD [7636]<br>toJavaRDD at <unknown>:0"]; 7638 [labelType="html" label="PythonRDD [7638]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17062 { label="MicroBatchScan"; 7624 [labelType="html" label="DataSourceRDD [7624]<br>run at <unknown>:0"]; 7625 [labelType="html" label="MapPartitionsRDD [7625]<br>run at <unknown>:0"]; } subgraph cluster17061 { label="Project"; 7626 [labelType="html" label="MapPartitionsRDD [7626]<br>run at <unknown>:0"]; } subgraph cluster17057 { label="WholeStageCodegen (1)"; 7627 [labelType="html" label="MapPartitionsRDD [7627]<br>run at <unknown>:0"]; } subgraph cluster17071 { label="WholeStageCodegen (1)"; 7629 [labelType="html" label="MapPartitionsRDD [7629]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17070 { label="Filter"; 7630 [labelType="html" label="MapPartitionsRDD [7630]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17069 { label="Project"; 7631 [labelType="html" label="MapPartitionsRDD [7631]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17066 { label="WholeStageCodegen (2)"; 7632 [labelType="html" label="MapPartitionsRDD [7632]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17065 { label="Project"; 7633 [labelType="html" label="MapPartitionsRDD [7633]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17064 { label="DeserializeToObject"; 7634 [labelType="html" label="MapPartitionsRDD [7634]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17063 { label="MapPartitions"; 7635 [labelType="html" label="MapPartitionsRDD [7635]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17073 { label="mapPartitions"; 7637 [labelType="html" label="MapPartitionsRDD [7637]<br>toJavaRDD at <unknown>:0"]; } } 7624->7625; 7625->7626; 7626->7627; 7627->7628; 7628->7629; 7629->7630; 7630->7631; 7631->7632; 7632->7633; 7633->7634; 7634->7635; 7635->7636; 7636->7637; 7637->7638; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time