3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 869 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 376
Associated Job Ids:
869
DAG Visualization
digraph G { subgraph clusterstage_869 { label="Stage 869"; 9118 [labelType="html" label="SQLExecutionRDD [9118]<br>run at <unknown>:0"]; 9132 [labelType="html" label="SQLExecutionRDD [9132]<br>toJavaRDD at <unknown>:0"]; 9134 [labelType="html" label="PythonRDD [9134]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20403 { label="MicroBatchScan"; 9114 [labelType="html" label="DataSourceRDD [9114]<br>run at <unknown>:0"]; 9115 [labelType="html" label="MapPartitionsRDD [9115]<br>run at <unknown>:0"]; } subgraph cluster20402 { label="Project"; 9116 [labelType="html" label="MapPartitionsRDD [9116]<br>run at <unknown>:0"]; } subgraph cluster20398 { label="WholeStageCodegen (1)"; 9117 [labelType="html" label="MapPartitionsRDD [9117]<br>run at <unknown>:0"]; } subgraph cluster20420 { label="WholeStageCodegen (1)"; 9125 [labelType="html" label="MapPartitionsRDD [9125]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20419 { label="Filter"; 9126 [labelType="html" label="MapPartitionsRDD [9126]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20418 { label="Project"; 9127 [labelType="html" label="MapPartitionsRDD [9127]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20415 { label="WholeStageCodegen (2)"; 9128 [labelType="html" label="MapPartitionsRDD [9128]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20414 { label="Project"; 9129 [labelType="html" label="MapPartitionsRDD [9129]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20413 { label="DeserializeToObject"; 9130 [labelType="html" label="MapPartitionsRDD [9130]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20412 { label="MapPartitions"; 9131 [labelType="html" label="MapPartitionsRDD [9131]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20422 { label="mapPartitions"; 9133 [labelType="html" label="MapPartitionsRDD [9133]<br>toJavaRDD at <unknown>:0"]; } } 9114->9115; 9115->9116; 9116->9117; 9117->9118; 9118->9125; 9125->9126; 9126->9127; 9127->9128; 9128->9129; 9129->9130; 9130->9131; 9131->9132; 9132->9133; 9133->9134; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time