3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 380 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 389
Associated Job Ids:
380
DAG Visualization
digraph G { subgraph clusterstage_380 { label="Stage 380"; 3994 [labelType="html" label="SQLExecutionRDD [3994]<br>run at <unknown>:0"]; 4002 [labelType="html" label="SQLExecutionRDD [4002]<br>toJavaRDD at <unknown>:0"]; 4004 [labelType="html" label="PythonRDD [4004]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8935 { label="MicroBatchScan"; 3990 [labelType="html" label="DataSourceRDD [3990]<br>run at <unknown>:0"]; 3991 [labelType="html" label="MapPartitionsRDD [3991]<br>run at <unknown>:0"]; } subgraph cluster8934 { label="Project"; 3992 [labelType="html" label="MapPartitionsRDD [3992]<br>run at <unknown>:0"]; } subgraph cluster8930 { label="WholeStageCodegen (1)"; 3993 [labelType="html" label="MapPartitionsRDD [3993]<br>run at <unknown>:0"]; } subgraph cluster8944 { label="WholeStageCodegen (1)"; 3995 [labelType="html" label="MapPartitionsRDD [3995]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8943 { label="Filter"; 3996 [labelType="html" label="MapPartitionsRDD [3996]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8942 { label="Project"; 3997 [labelType="html" label="MapPartitionsRDD [3997]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8939 { label="WholeStageCodegen (2)"; 3998 [labelType="html" label="MapPartitionsRDD [3998]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8938 { label="Project"; 3999 [labelType="html" label="MapPartitionsRDD [3999]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8937 { label="DeserializeToObject"; 4000 [labelType="html" label="MapPartitionsRDD [4000]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8936 { label="MapPartitions"; 4001 [labelType="html" label="MapPartitionsRDD [4001]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8946 { label="mapPartitions"; 4003 [labelType="html" label="MapPartitionsRDD [4003]<br>toJavaRDD at <unknown>:0"]; } } 3990->3991; 3991->3992; 3992->3993; 3993->3994; 3994->3995; 3995->3996; 3996->3997; 3997->3998; 3998->3999; 3999->4000; 4000->4001; 4001->4002; 4002->4003; 4003->4004; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time