3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 141 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 440
Associated Job Ids:
141
DAG Visualization
digraph G { subgraph clusterstage_141 { label="Stage 141"; 1474 [labelType="html" label="SQLExecutionRDD [1474]<br>run at <unknown>:0"]; 1488 [labelType="html" label="SQLExecutionRDD [1488]<br>toJavaRDD at <unknown>:0"]; 1490 [labelType="html" label="PythonRDD [1490]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster3295 { label="MicroBatchScan"; 1470 [labelType="html" label="DataSourceRDD [1470]<br>run at <unknown>:0"]; 1471 [labelType="html" label="MapPartitionsRDD [1471]<br>run at <unknown>:0"]; } subgraph cluster3294 { label="Project"; 1472 [labelType="html" label="MapPartitionsRDD [1472]<br>run at <unknown>:0"]; } subgraph cluster3290 { label="WholeStageCodegen (1)"; 1473 [labelType="html" label="MapPartitionsRDD [1473]<br>run at <unknown>:0"]; } subgraph cluster3312 { label="WholeStageCodegen (1)"; 1481 [labelType="html" label="MapPartitionsRDD [1481]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3311 { label="Filter"; 1482 [labelType="html" label="MapPartitionsRDD [1482]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3310 { label="Project"; 1483 [labelType="html" label="MapPartitionsRDD [1483]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3307 { label="WholeStageCodegen (2)"; 1484 [labelType="html" label="MapPartitionsRDD [1484]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3306 { label="Project"; 1485 [labelType="html" label="MapPartitionsRDD [1485]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3305 { label="DeserializeToObject"; 1486 [labelType="html" label="MapPartitionsRDD [1486]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3304 { label="MapPartitions"; 1487 [labelType="html" label="MapPartitionsRDD [1487]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3314 { label="mapPartitions"; 1489 [labelType="html" label="MapPartitionsRDD [1489]<br>toJavaRDD at <unknown>:0"]; } } 1470->1471; 1471->1472; 1472->1473; 1473->1474; 1474->1481; 1481->1482; 1482->1483; 1483->1484; 1484->1485; 1485->1486; 1486->1487; 1487->1488; 1488->1489; 1489->1490; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time