3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 818 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 523
Associated Job Ids:
818
DAG Visualization
digraph G { subgraph clusterstage_818 { label="Stage 818"; 8593 [labelType="html" label="SQLExecutionRDD [8593]<br>run at <unknown>:0"]; 8601 [labelType="html" label="SQLExecutionRDD [8601]<br>toJavaRDD at <unknown>:0"]; 8603 [labelType="html" label="PythonRDD [8603]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster19228 { label="MicroBatchScan"; 8589 [labelType="html" label="DataSourceRDD [8589]<br>run at <unknown>:0"]; 8590 [labelType="html" label="MapPartitionsRDD [8590]<br>run at <unknown>:0"]; } subgraph cluster19227 { label="Project"; 8591 [labelType="html" label="MapPartitionsRDD [8591]<br>run at <unknown>:0"]; } subgraph cluster19223 { label="WholeStageCodegen (1)"; 8592 [labelType="html" label="MapPartitionsRDD [8592]<br>run at <unknown>:0"]; } subgraph cluster19237 { label="WholeStageCodegen (1)"; 8594 [labelType="html" label="MapPartitionsRDD [8594]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19236 { label="Filter"; 8595 [labelType="html" label="MapPartitionsRDD [8595]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19235 { label="Project"; 8596 [labelType="html" label="MapPartitionsRDD [8596]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19232 { label="WholeStageCodegen (2)"; 8597 [labelType="html" label="MapPartitionsRDD [8597]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19231 { label="Project"; 8598 [labelType="html" label="MapPartitionsRDD [8598]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19230 { label="DeserializeToObject"; 8599 [labelType="html" label="MapPartitionsRDD [8599]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19229 { label="MapPartitions"; 8600 [labelType="html" label="MapPartitionsRDD [8600]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster19239 { label="mapPartitions"; 8602 [labelType="html" label="MapPartitionsRDD [8602]<br>toJavaRDD at <unknown>:0"]; } } 8589->8590; 8590->8591; 8591->8592; 8592->8593; 8593->8594; 8594->8595; 8595->8596; 8596->8597; 8597->8598; 8598->8599; 8599->8600; 8600->8601; 8601->8602; 8602->8603; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time