3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 628 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 417
Associated Job Ids:
628
DAG Visualization
digraph G { subgraph clusterstage_628 { label="Stage 628"; 6598 [labelType="html" label="SQLExecutionRDD [6598]<br>run at <unknown>:0"]; 6606 [labelType="html" label="SQLExecutionRDD [6606]<br>toJavaRDD at <unknown>:0"]; 6608 [labelType="html" label="PythonRDD [6608]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster14763 { label="MicroBatchScan"; 6594 [labelType="html" label="DataSourceRDD [6594]<br>run at <unknown>:0"]; 6595 [labelType="html" label="MapPartitionsRDD [6595]<br>run at <unknown>:0"]; } subgraph cluster14762 { label="Project"; 6596 [labelType="html" label="MapPartitionsRDD [6596]<br>run at <unknown>:0"]; } subgraph cluster14758 { label="WholeStageCodegen (1)"; 6597 [labelType="html" label="MapPartitionsRDD [6597]<br>run at <unknown>:0"]; } subgraph cluster14772 { label="WholeStageCodegen (1)"; 6599 [labelType="html" label="MapPartitionsRDD [6599]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14771 { label="Filter"; 6600 [labelType="html" label="MapPartitionsRDD [6600]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14770 { label="Project"; 6601 [labelType="html" label="MapPartitionsRDD [6601]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14767 { label="WholeStageCodegen (2)"; 6602 [labelType="html" label="MapPartitionsRDD [6602]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14766 { label="Project"; 6603 [labelType="html" label="MapPartitionsRDD [6603]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14765 { label="DeserializeToObject"; 6604 [labelType="html" label="MapPartitionsRDD [6604]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14764 { label="MapPartitions"; 6605 [labelType="html" label="MapPartitionsRDD [6605]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster14774 { label="mapPartitions"; 6607 [labelType="html" label="MapPartitionsRDD [6607]<br>toJavaRDD at <unknown>:0"]; } } 6594->6595; 6595->6596; 6596->6597; 6597->6598; 6598->6599; 6599->6600; 6600->6601; 6601->6602; 6602->6603; 6603->6604; 6604->6605; 6605->6606; 6606->6607; 6607->6608; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time