3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 282 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 448
Associated Job Ids:
282
DAG Visualization
digraph G { subgraph clusterstage_282 { label="Stage 282"; 2965 [labelType="html" label="SQLExecutionRDD [2965]<br>run at <unknown>:0"]; 2973 [labelType="html" label="SQLExecutionRDD [2973]<br>toJavaRDD at <unknown>:0"]; 2975 [labelType="html" label="PythonRDD [2975]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6632 { label="MicroBatchScan"; 2961 [labelType="html" label="DataSourceRDD [2961]<br>run at <unknown>:0"]; 2962 [labelType="html" label="MapPartitionsRDD [2962]<br>run at <unknown>:0"]; } subgraph cluster6631 { label="Project"; 2963 [labelType="html" label="MapPartitionsRDD [2963]<br>run at <unknown>:0"]; } subgraph cluster6627 { label="WholeStageCodegen (1)"; 2964 [labelType="html" label="MapPartitionsRDD [2964]<br>run at <unknown>:0"]; } subgraph cluster6641 { label="WholeStageCodegen (1)"; 2966 [labelType="html" label="MapPartitionsRDD [2966]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6640 { label="Filter"; 2967 [labelType="html" label="MapPartitionsRDD [2967]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6639 { label="Project"; 2968 [labelType="html" label="MapPartitionsRDD [2968]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6636 { label="WholeStageCodegen (2)"; 2969 [labelType="html" label="MapPartitionsRDD [2969]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6635 { label="Project"; 2970 [labelType="html" label="MapPartitionsRDD [2970]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6634 { label="DeserializeToObject"; 2971 [labelType="html" label="MapPartitionsRDD [2971]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6633 { label="MapPartitions"; 2972 [labelType="html" label="MapPartitionsRDD [2972]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6643 { label="mapPartitions"; 2974 [labelType="html" label="MapPartitionsRDD [2974]<br>toJavaRDD at <unknown>:0"]; } } 2961->2962; 2962->2963; 2963->2964; 2964->2965; 2965->2966; 2966->2967; 2967->2968; 2968->2969; 2969->2970; 2970->2971; 2971->2972; 2972->2973; 2973->2974; 2974->2975; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time