3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1420 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 497
Associated Job Ids:
1421
DAG Visualization
digraph G { subgraph clusterstage_1420 { label="Stage 1420"; 14921 [labelType="html" label="SQLExecutionRDD [14921]<br>run at <unknown>:0"]; 14929 [labelType="html" label="SQLExecutionRDD [14929]<br>toJavaRDD at <unknown>:0"]; 14931 [labelType="html" label="PythonRDD [14931]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster33379 { label="MicroBatchScan"; 14917 [labelType="html" label="DataSourceRDD [14917]<br>run at <unknown>:0"]; 14918 [labelType="html" label="MapPartitionsRDD [14918]<br>run at <unknown>:0"]; } subgraph cluster33378 { label="Project"; 14919 [labelType="html" label="MapPartitionsRDD [14919]<br>run at <unknown>:0"]; } subgraph cluster33372 { label="WholeStageCodegen (1)"; 14920 [labelType="html" label="MapPartitionsRDD [14920]<br>run at <unknown>:0"]; } subgraph cluster33388 { label="WholeStageCodegen (1)"; 14922 [labelType="html" label="MapPartitionsRDD [14922]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33387 { label="Filter"; 14923 [labelType="html" label="MapPartitionsRDD [14923]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33386 { label="Project"; 14924 [labelType="html" label="MapPartitionsRDD [14924]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33383 { label="WholeStageCodegen (2)"; 14925 [labelType="html" label="MapPartitionsRDD [14925]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33382 { label="Project"; 14926 [labelType="html" label="MapPartitionsRDD [14926]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33381 { label="DeserializeToObject"; 14927 [labelType="html" label="MapPartitionsRDD [14927]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33380 { label="MapPartitions"; 14928 [labelType="html" label="MapPartitionsRDD [14928]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster33390 { label="mapPartitions"; 14930 [labelType="html" label="MapPartitionsRDD [14930]<br>toJavaRDD at <unknown>:0"]; } } 14917->14918; 14918->14919; 14919->14920; 14920->14921; 14921->14922; 14922->14923; 14923->14924; 14924->14925; 14925->14926; 14926->14927; 14927->14928; 14928->14929; 14929->14930; 14930->14931; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time