3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1127 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 481
Associated Job Ids:
1128
DAG Visualization
digraph G { subgraph clusterstage_1127 { label="Stage 1127"; 11849 [labelType="html" label="SQLExecutionRDD [11849]<br>run at <unknown>:0"]; 11857 [labelType="html" label="SQLExecutionRDD [11857]<br>toJavaRDD at <unknown>:0"]; 11859 [labelType="html" label="PythonRDD [11859]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26509 { label="MicroBatchScan"; 11845 [labelType="html" label="DataSourceRDD [11845]<br>run at <unknown>:0"]; 11846 [labelType="html" label="MapPartitionsRDD [11846]<br>run at <unknown>:0"]; } subgraph cluster26508 { label="Project"; 11847 [labelType="html" label="MapPartitionsRDD [11847]<br>run at <unknown>:0"]; } subgraph cluster26504 { label="WholeStageCodegen (1)"; 11848 [labelType="html" label="MapPartitionsRDD [11848]<br>run at <unknown>:0"]; } subgraph cluster26518 { label="WholeStageCodegen (1)"; 11850 [labelType="html" label="MapPartitionsRDD [11850]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26517 { label="Filter"; 11851 [labelType="html" label="MapPartitionsRDD [11851]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26516 { label="Project"; 11852 [labelType="html" label="MapPartitionsRDD [11852]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26513 { label="WholeStageCodegen (2)"; 11853 [labelType="html" label="MapPartitionsRDD [11853]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26512 { label="Project"; 11854 [labelType="html" label="MapPartitionsRDD [11854]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26511 { label="DeserializeToObject"; 11855 [labelType="html" label="MapPartitionsRDD [11855]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26510 { label="MapPartitions"; 11856 [labelType="html" label="MapPartitionsRDD [11856]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26520 { label="mapPartitions"; 11858 [labelType="html" label="MapPartitionsRDD [11858]<br>toJavaRDD at <unknown>:0"]; } } 11845->11846; 11846->11847; 11847->11848; 11848->11849; 11849->11850; 11850->11851; 11851->11852; 11852->11853; 11853->11854; 11854->11855; 11855->11856; 11856->11857; 11857->11858; 11858->11859; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time