3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 425 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 469
Associated Job Ids:
426
DAG Visualization
digraph G { subgraph clusterstage_425 { label="Stage 425"; 4478 [labelType="html" label="SQLExecutionRDD [4478]<br>run at <unknown>:0"]; 4486 [labelType="html" label="SQLExecutionRDD [4486]<br>toJavaRDD at <unknown>:0"]; 4488 [labelType="html" label="PythonRDD [4488]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10012 { label="MicroBatchScan"; 4474 [labelType="html" label="DataSourceRDD [4474]<br>run at <unknown>:0"]; 4475 [labelType="html" label="MapPartitionsRDD [4475]<br>run at <unknown>:0"]; } subgraph cluster10011 { label="Project"; 4476 [labelType="html" label="MapPartitionsRDD [4476]<br>run at <unknown>:0"]; } subgraph cluster10007 { label="WholeStageCodegen (1)"; 4477 [labelType="html" label="MapPartitionsRDD [4477]<br>run at <unknown>:0"]; } subgraph cluster10021 { label="WholeStageCodegen (1)"; 4479 [labelType="html" label="MapPartitionsRDD [4479]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10020 { label="Filter"; 4480 [labelType="html" label="MapPartitionsRDD [4480]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10019 { label="Project"; 4481 [labelType="html" label="MapPartitionsRDD [4481]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10016 { label="WholeStageCodegen (2)"; 4482 [labelType="html" label="MapPartitionsRDD [4482]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10015 { label="Project"; 4483 [labelType="html" label="MapPartitionsRDD [4483]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10014 { label="DeserializeToObject"; 4484 [labelType="html" label="MapPartitionsRDD [4484]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10013 { label="MapPartitions"; 4485 [labelType="html" label="MapPartitionsRDD [4485]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10023 { label="mapPartitions"; 4487 [labelType="html" label="MapPartitionsRDD [4487]<br>toJavaRDD at <unknown>:0"]; } } 4474->4475; 4475->4476; 4476->4477; 4477->4478; 4478->4479; 4479->4480; 4480->4481; 4481->4482; 4482->4483; 4483->4484; 4484->4485; 4485->4486; 4486->4487; 4487->4488; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time