3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 754 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 331
Associated Job Ids:
754
DAG Visualization
digraph G { subgraph clusterstage_754 { label="Stage 754"; 7921 [labelType="html" label="SQLExecutionRDD [7921]<br>run at <unknown>:0"]; 7929 [labelType="html" label="SQLExecutionRDD [7929]<br>toJavaRDD at <unknown>:0"]; 7931 [labelType="html" label="PythonRDD [7931]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17724 { label="MicroBatchScan"; 7917 [labelType="html" label="DataSourceRDD [7917]<br>run at <unknown>:0"]; 7918 [labelType="html" label="MapPartitionsRDD [7918]<br>run at <unknown>:0"]; } subgraph cluster17723 { label="Project"; 7919 [labelType="html" label="MapPartitionsRDD [7919]<br>run at <unknown>:0"]; } subgraph cluster17719 { label="WholeStageCodegen (1)"; 7920 [labelType="html" label="MapPartitionsRDD [7920]<br>run at <unknown>:0"]; } subgraph cluster17733 { label="WholeStageCodegen (1)"; 7922 [labelType="html" label="MapPartitionsRDD [7922]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17732 { label="Filter"; 7923 [labelType="html" label="MapPartitionsRDD [7923]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17731 { label="Project"; 7924 [labelType="html" label="MapPartitionsRDD [7924]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17728 { label="WholeStageCodegen (2)"; 7925 [labelType="html" label="MapPartitionsRDD [7925]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17727 { label="Project"; 7926 [labelType="html" label="MapPartitionsRDD [7926]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17726 { label="DeserializeToObject"; 7927 [labelType="html" label="MapPartitionsRDD [7927]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17725 { label="MapPartitions"; 7928 [labelType="html" label="MapPartitionsRDD [7928]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17735 { label="mapPartitions"; 7930 [labelType="html" label="MapPartitionsRDD [7930]<br>toJavaRDD at <unknown>:0"]; } } 7917->7918; 7918->7919; 7919->7920; 7920->7921; 7921->7922; 7922->7923; 7923->7924; 7924->7925; 7925->7926; 7926->7927; 7927->7928; 7928->7929; 7929->7930; 7930->7931; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time