3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 270 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 501
Associated Job Ids:
270
DAG Visualization
digraph G { subgraph clusterstage_270 { label="Stage 270"; 2839 [labelType="html" label="SQLExecutionRDD [2839]<br>run at <unknown>:0"]; 2847 [labelType="html" label="SQLExecutionRDD [2847]<br>toJavaRDD at <unknown>:0"]; 2849 [labelType="html" label="PythonRDD [2849]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6350 { label="MicroBatchScan"; 2835 [labelType="html" label="DataSourceRDD [2835]<br>run at <unknown>:0"]; 2836 [labelType="html" label="MapPartitionsRDD [2836]<br>run at <unknown>:0"]; } subgraph cluster6349 { label="Project"; 2837 [labelType="html" label="MapPartitionsRDD [2837]<br>run at <unknown>:0"]; } subgraph cluster6345 { label="WholeStageCodegen (1)"; 2838 [labelType="html" label="MapPartitionsRDD [2838]<br>run at <unknown>:0"]; } subgraph cluster6359 { label="WholeStageCodegen (1)"; 2840 [labelType="html" label="MapPartitionsRDD [2840]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6358 { label="Filter"; 2841 [labelType="html" label="MapPartitionsRDD [2841]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6357 { label="Project"; 2842 [labelType="html" label="MapPartitionsRDD [2842]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6354 { label="WholeStageCodegen (2)"; 2843 [labelType="html" label="MapPartitionsRDD [2843]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6353 { label="Project"; 2844 [labelType="html" label="MapPartitionsRDD [2844]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6352 { label="DeserializeToObject"; 2845 [labelType="html" label="MapPartitionsRDD [2845]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6351 { label="MapPartitions"; 2846 [labelType="html" label="MapPartitionsRDD [2846]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6361 { label="mapPartitions"; 2848 [labelType="html" label="MapPartitionsRDD [2848]<br>toJavaRDD at <unknown>:0"]; } } 2835->2836; 2836->2837; 2837->2838; 2838->2839; 2839->2840; 2840->2841; 2841->2842; 2842->2843; 2843->2844; 2844->2845; 2845->2846; 2846->2847; 2847->2848; 2848->2849; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time