3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 254 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 398
Associated Job Ids:
254
DAG Visualization
digraph G { subgraph clusterstage_254 { label="Stage 254"; 2671 [labelType="html" label="SQLExecutionRDD [2671]<br>run at <unknown>:0"]; 2679 [labelType="html" label="SQLExecutionRDD [2679]<br>toJavaRDD at <unknown>:0"]; 2681 [labelType="html" label="PythonRDD [2681]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster5974 { label="MicroBatchScan"; 2667 [labelType="html" label="DataSourceRDD [2667]<br>run at <unknown>:0"]; 2668 [labelType="html" label="MapPartitionsRDD [2668]<br>run at <unknown>:0"]; } subgraph cluster5973 { label="Project"; 2669 [labelType="html" label="MapPartitionsRDD [2669]<br>run at <unknown>:0"]; } subgraph cluster5969 { label="WholeStageCodegen (1)"; 2670 [labelType="html" label="MapPartitionsRDD [2670]<br>run at <unknown>:0"]; } subgraph cluster5983 { label="WholeStageCodegen (1)"; 2672 [labelType="html" label="MapPartitionsRDD [2672]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5982 { label="Filter"; 2673 [labelType="html" label="MapPartitionsRDD [2673]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5981 { label="Project"; 2674 [labelType="html" label="MapPartitionsRDD [2674]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5978 { label="WholeStageCodegen (2)"; 2675 [labelType="html" label="MapPartitionsRDD [2675]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5977 { label="Project"; 2676 [labelType="html" label="MapPartitionsRDD [2676]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5976 { label="DeserializeToObject"; 2677 [labelType="html" label="MapPartitionsRDD [2677]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5975 { label="MapPartitions"; 2678 [labelType="html" label="MapPartitionsRDD [2678]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5985 { label="mapPartitions"; 2680 [labelType="html" label="MapPartitionsRDD [2680]<br>toJavaRDD at <unknown>:0"]; } } 2667->2668; 2668->2669; 2669->2670; 2670->2671; 2671->2672; 2672->2673; 2673->2674; 2674->2675; 2675->2676; 2676->2677; 2677->2678; 2678->2679; 2679->2680; 2680->2681; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time