3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1171 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 452
Associated Job Ids:
1172
DAG Visualization
digraph G { subgraph clusterstage_1171 { label="Stage 1171"; 12311 [labelType="html" label="SQLExecutionRDD [12311]<br>run at <unknown>:0"]; 12319 [labelType="html" label="SQLExecutionRDD [12319]<br>toJavaRDD at <unknown>:0"]; 12321 [labelType="html" label="PythonRDD [12321]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster27543 { label="MicroBatchScan"; 12307 [labelType="html" label="DataSourceRDD [12307]<br>run at <unknown>:0"]; 12308 [labelType="html" label="MapPartitionsRDD [12308]<br>run at <unknown>:0"]; } subgraph cluster27542 { label="Project"; 12309 [labelType="html" label="MapPartitionsRDD [12309]<br>run at <unknown>:0"]; } subgraph cluster27538 { label="WholeStageCodegen (1)"; 12310 [labelType="html" label="MapPartitionsRDD [12310]<br>run at <unknown>:0"]; } subgraph cluster27552 { label="WholeStageCodegen (1)"; 12312 [labelType="html" label="MapPartitionsRDD [12312]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27551 { label="Filter"; 12313 [labelType="html" label="MapPartitionsRDD [12313]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27550 { label="Project"; 12314 [labelType="html" label="MapPartitionsRDD [12314]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27547 { label="WholeStageCodegen (2)"; 12315 [labelType="html" label="MapPartitionsRDD [12315]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27546 { label="Project"; 12316 [labelType="html" label="MapPartitionsRDD [12316]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27545 { label="DeserializeToObject"; 12317 [labelType="html" label="MapPartitionsRDD [12317]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27544 { label="MapPartitions"; 12318 [labelType="html" label="MapPartitionsRDD [12318]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster27554 { label="mapPartitions"; 12320 [labelType="html" label="MapPartitionsRDD [12320]<br>toJavaRDD at <unknown>:0"]; } } 12307->12308; 12308->12309; 12309->12310; 12310->12311; 12311->12312; 12312->12313; 12313->12314; 12314->12315; 12315->12316; 12316->12317; 12317->12318; 12318->12319; 12319->12320; 12320->12321; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time