3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 967 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 360
Associated Job Ids:
968
DAG Visualization
digraph G { subgraph clusterstage_967 { label="Stage 967"; 10169 [labelType="html" label="SQLExecutionRDD [10169]<br>run at <unknown>:0"]; 10177 [labelType="html" label="SQLExecutionRDD [10177]<br>toJavaRDD at <unknown>:0"]; 10179 [labelType="html" label="PythonRDD [10179]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster22749 { label="MicroBatchScan"; 10165 [labelType="html" label="DataSourceRDD [10165]<br>run at <unknown>:0"]; 10166 [labelType="html" label="MapPartitionsRDD [10166]<br>run at <unknown>:0"]; } subgraph cluster22748 { label="Project"; 10167 [labelType="html" label="MapPartitionsRDD [10167]<br>run at <unknown>:0"]; } subgraph cluster22744 { label="WholeStageCodegen (1)"; 10168 [labelType="html" label="MapPartitionsRDD [10168]<br>run at <unknown>:0"]; } subgraph cluster22758 { label="WholeStageCodegen (1)"; 10170 [labelType="html" label="MapPartitionsRDD [10170]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22757 { label="Filter"; 10171 [labelType="html" label="MapPartitionsRDD [10171]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22756 { label="Project"; 10172 [labelType="html" label="MapPartitionsRDD [10172]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22753 { label="WholeStageCodegen (2)"; 10173 [labelType="html" label="MapPartitionsRDD [10173]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22752 { label="Project"; 10174 [labelType="html" label="MapPartitionsRDD [10174]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22751 { label="DeserializeToObject"; 10175 [labelType="html" label="MapPartitionsRDD [10175]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22750 { label="MapPartitions"; 10176 [labelType="html" label="MapPartitionsRDD [10176]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22760 { label="mapPartitions"; 10178 [labelType="html" label="MapPartitionsRDD [10178]<br>toJavaRDD at <unknown>:0"]; } } 10165->10166; 10166->10167; 10167->10168; 10168->10169; 10169->10170; 10170->10171; 10171->10172; 10172->10173; 10173->10174; 10174->10175; 10175->10176; 10176->10177; 10177->10178; 10178->10179; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time