3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 861 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 421
Associated Job Ids:
861
DAG Visualization
digraph G { subgraph clusterstage_861 { label="Stage 861"; 9040 [labelType="html" label="SQLExecutionRDD [9040]<br>run at <unknown>:0"]; 9048 [labelType="html" label="SQLExecutionRDD [9048]<br>toJavaRDD at <unknown>:0"]; 9050 [labelType="html" label="PythonRDD [9050]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster20223 { label="MicroBatchScan"; 9036 [labelType="html" label="DataSourceRDD [9036]<br>run at <unknown>:0"]; 9037 [labelType="html" label="MapPartitionsRDD [9037]<br>run at <unknown>:0"]; } subgraph cluster20222 { label="Project"; 9038 [labelType="html" label="MapPartitionsRDD [9038]<br>run at <unknown>:0"]; } subgraph cluster20218 { label="WholeStageCodegen (1)"; 9039 [labelType="html" label="MapPartitionsRDD [9039]<br>run at <unknown>:0"]; } subgraph cluster20232 { label="WholeStageCodegen (1)"; 9041 [labelType="html" label="MapPartitionsRDD [9041]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20231 { label="Filter"; 9042 [labelType="html" label="MapPartitionsRDD [9042]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20230 { label="Project"; 9043 [labelType="html" label="MapPartitionsRDD [9043]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20227 { label="WholeStageCodegen (2)"; 9044 [labelType="html" label="MapPartitionsRDD [9044]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20226 { label="Project"; 9045 [labelType="html" label="MapPartitionsRDD [9045]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20225 { label="DeserializeToObject"; 9046 [labelType="html" label="MapPartitionsRDD [9046]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20224 { label="MapPartitions"; 9047 [labelType="html" label="MapPartitionsRDD [9047]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster20234 { label="mapPartitions"; 9049 [labelType="html" label="MapPartitionsRDD [9049]<br>toJavaRDD at <unknown>:0"]; } } 9036->9037; 9037->9038; 9038->9039; 9039->9040; 9040->9041; 9041->9042; 9042->9043; 9043->9044; 9044->9045; 9045->9046; 9046->9047; 9047->9048; 9048->9049; 9049->9050; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time