3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 280 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 388
Associated Job Ids:
280
DAG Visualization
digraph G { subgraph clusterstage_280 { label="Stage 280"; 2944 [labelType="html" label="SQLExecutionRDD [2944]<br>run at <unknown>:0"]; 2952 [labelType="html" label="SQLExecutionRDD [2952]<br>toJavaRDD at <unknown>:0"]; 2954 [labelType="html" label="PythonRDD [2954]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6585 { label="MicroBatchScan"; 2940 [labelType="html" label="DataSourceRDD [2940]<br>run at <unknown>:0"]; 2941 [labelType="html" label="MapPartitionsRDD [2941]<br>run at <unknown>:0"]; } subgraph cluster6584 { label="Project"; 2942 [labelType="html" label="MapPartitionsRDD [2942]<br>run at <unknown>:0"]; } subgraph cluster6580 { label="WholeStageCodegen (1)"; 2943 [labelType="html" label="MapPartitionsRDD [2943]<br>run at <unknown>:0"]; } subgraph cluster6594 { label="WholeStageCodegen (1)"; 2945 [labelType="html" label="MapPartitionsRDD [2945]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6593 { label="Filter"; 2946 [labelType="html" label="MapPartitionsRDD [2946]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6592 { label="Project"; 2947 [labelType="html" label="MapPartitionsRDD [2947]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6589 { label="WholeStageCodegen (2)"; 2948 [labelType="html" label="MapPartitionsRDD [2948]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6588 { label="Project"; 2949 [labelType="html" label="MapPartitionsRDD [2949]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6587 { label="DeserializeToObject"; 2950 [labelType="html" label="MapPartitionsRDD [2950]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6586 { label="MapPartitions"; 2951 [labelType="html" label="MapPartitionsRDD [2951]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6596 { label="mapPartitions"; 2953 [labelType="html" label="MapPartitionsRDD [2953]<br>toJavaRDD at <unknown>:0"]; } } 2940->2941; 2941->2942; 2942->2943; 2943->2944; 2944->2945; 2945->2946; 2946->2947; 2947->2948; 2948->2949; 2949->2950; 2950->2951; 2951->2952; 2952->2953; 2953->2954; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time