3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 911 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 452
Associated Job Ids:
912
DAG Visualization
digraph G { subgraph clusterstage_911 { label="Stage 911"; 9581 [labelType="html" label="SQLExecutionRDD [9581]<br>run at <unknown>:0"]; 9589 [labelType="html" label="SQLExecutionRDD [9589]<br>toJavaRDD at <unknown>:0"]; 9591 [labelType="html" label="PythonRDD [9591]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21433 { label="MicroBatchScan"; 9577 [labelType="html" label="DataSourceRDD [9577]<br>run at <unknown>:0"]; 9578 [labelType="html" label="MapPartitionsRDD [9578]<br>run at <unknown>:0"]; } subgraph cluster21432 { label="Project"; 9579 [labelType="html" label="MapPartitionsRDD [9579]<br>run at <unknown>:0"]; } subgraph cluster21428 { label="WholeStageCodegen (1)"; 9580 [labelType="html" label="MapPartitionsRDD [9580]<br>run at <unknown>:0"]; } subgraph cluster21442 { label="WholeStageCodegen (1)"; 9582 [labelType="html" label="MapPartitionsRDD [9582]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21441 { label="Filter"; 9583 [labelType="html" label="MapPartitionsRDD [9583]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21440 { label="Project"; 9584 [labelType="html" label="MapPartitionsRDD [9584]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21437 { label="WholeStageCodegen (2)"; 9585 [labelType="html" label="MapPartitionsRDD [9585]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21436 { label="Project"; 9586 [labelType="html" label="MapPartitionsRDD [9586]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21435 { label="DeserializeToObject"; 9587 [labelType="html" label="MapPartitionsRDD [9587]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21434 { label="MapPartitions"; 9588 [labelType="html" label="MapPartitionsRDD [9588]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21444 { label="mapPartitions"; 9590 [labelType="html" label="MapPartitionsRDD [9590]<br>toJavaRDD at <unknown>:0"]; } } 9577->9578; 9578->9579; 9579->9580; 9580->9581; 9581->9582; 9582->9583; 9583->9584; 9584->9585; 9585->9586; 9586->9587; 9587->9588; 9588->9589; 9589->9590; 9590->9591; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time