3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 2060 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 527
Associated Job Ids:
2061
DAG Visualization
digraph G { subgraph clusterstage_2060 { label="Stage 2060"; 21635 [labelType="html" label="SQLExecutionRDD [21635]<br>run at <unknown>:0"]; 21649 [labelType="html" label="SQLExecutionRDD [21649]<br>toJavaRDD at <unknown>:0"]; 21651 [labelType="html" label="PythonRDD [21651]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster48411 { label="MicroBatchScan"; 21631 [labelType="html" label="DataSourceRDD [21631]<br>run at <unknown>:0"]; 21632 [labelType="html" label="MapPartitionsRDD [21632]<br>run at <unknown>:0"]; } subgraph cluster48410 { label="Project"; 21633 [labelType="html" label="MapPartitionsRDD [21633]<br>run at <unknown>:0"]; } subgraph cluster48406 { label="WholeStageCodegen (1)"; 21634 [labelType="html" label="MapPartitionsRDD [21634]<br>run at <unknown>:0"]; } subgraph cluster48428 { label="WholeStageCodegen (1)"; 21642 [labelType="html" label="MapPartitionsRDD [21642]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48427 { label="Filter"; 21643 [labelType="html" label="MapPartitionsRDD [21643]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48426 { label="Project"; 21644 [labelType="html" label="MapPartitionsRDD [21644]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48423 { label="WholeStageCodegen (2)"; 21645 [labelType="html" label="MapPartitionsRDD [21645]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48422 { label="Project"; 21646 [labelType="html" label="MapPartitionsRDD [21646]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48421 { label="DeserializeToObject"; 21647 [labelType="html" label="MapPartitionsRDD [21647]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48420 { label="MapPartitions"; 21648 [labelType="html" label="MapPartitionsRDD [21648]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster48430 { label="mapPartitions"; 21650 [labelType="html" label="MapPartitionsRDD [21650]<br>toJavaRDD at <unknown>:0"]; } } 21631->21632; 21632->21633; 21633->21634; 21634->21635; 21635->21642; 21642->21643; 21643->21644; 21644->21645; 21645->21646; 21646->21647; 21647->21648; 21648->21649; 21649->21650; 21650->21651; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time