3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 61 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 499
Associated Job Ids:
61
DAG Visualization
digraph G { subgraph clusterstage_61 { label="Stage 61"; 634 [labelType="html" label="SQLExecutionRDD [634]<br>run at <unknown>:0"]; 648 [labelType="html" label="SQLExecutionRDD [648]<br>toJavaRDD at <unknown>:0"]; 650 [labelType="html" label="PythonRDD [650]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster1415 { label="MicroBatchScan"; 630 [labelType="html" label="DataSourceRDD [630]<br>run at <unknown>:0"]; 631 [labelType="html" label="MapPartitionsRDD [631]<br>run at <unknown>:0"]; } subgraph cluster1414 { label="Project"; 632 [labelType="html" label="MapPartitionsRDD [632]<br>run at <unknown>:0"]; } subgraph cluster1410 { label="WholeStageCodegen (1)"; 633 [labelType="html" label="MapPartitionsRDD [633]<br>run at <unknown>:0"]; } subgraph cluster1432 { label="WholeStageCodegen (1)"; 641 [labelType="html" label="MapPartitionsRDD [641]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1431 { label="Filter"; 642 [labelType="html" label="MapPartitionsRDD [642]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1430 { label="Project"; 643 [labelType="html" label="MapPartitionsRDD [643]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1427 { label="WholeStageCodegen (2)"; 644 [labelType="html" label="MapPartitionsRDD [644]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1426 { label="Project"; 645 [labelType="html" label="MapPartitionsRDD [645]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1425 { label="DeserializeToObject"; 646 [labelType="html" label="MapPartitionsRDD [646]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1424 { label="MapPartitions"; 647 [labelType="html" label="MapPartitionsRDD [647]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1434 { label="mapPartitions"; 649 [labelType="html" label="MapPartitionsRDD [649]<br>toJavaRDD at <unknown>:0"]; } } 630->631; 631->632; 632->633; 633->634; 634->641; 641->642; 642->643; 643->644; 644->645; 645->646; 646->647; 647->648; 648->649; 649->650; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time