3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1886 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 482
Associated Job Ids:
1886
DAG Visualization
digraph G { subgraph clusterstage_1886 { label="Stage 1886"; 19807 [labelType="html" label="SQLExecutionRDD [19807]<br>run at <unknown>:0"]; 19815 [labelType="html" label="SQLExecutionRDD [19815]<br>toJavaRDD at <unknown>:0"]; 19817 [labelType="html" label="PythonRDD [19817]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster44326 { label="MicroBatchScan"; 19803 [labelType="html" label="DataSourceRDD [19803]<br>run at <unknown>:0"]; 19804 [labelType="html" label="MapPartitionsRDD [19804]<br>run at <unknown>:0"]; } subgraph cluster44325 { label="Project"; 19805 [labelType="html" label="MapPartitionsRDD [19805]<br>run at <unknown>:0"]; } subgraph cluster44321 { label="WholeStageCodegen (1)"; 19806 [labelType="html" label="MapPartitionsRDD [19806]<br>run at <unknown>:0"]; } subgraph cluster44335 { label="WholeStageCodegen (1)"; 19808 [labelType="html" label="MapPartitionsRDD [19808]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44334 { label="Filter"; 19809 [labelType="html" label="MapPartitionsRDD [19809]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44333 { label="Project"; 19810 [labelType="html" label="MapPartitionsRDD [19810]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44330 { label="WholeStageCodegen (2)"; 19811 [labelType="html" label="MapPartitionsRDD [19811]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44329 { label="Project"; 19812 [labelType="html" label="MapPartitionsRDD [19812]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44328 { label="DeserializeToObject"; 19813 [labelType="html" label="MapPartitionsRDD [19813]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44327 { label="MapPartitions"; 19814 [labelType="html" label="MapPartitionsRDD [19814]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster44337 { label="mapPartitions"; 19816 [labelType="html" label="MapPartitionsRDD [19816]<br>toJavaRDD at <unknown>:0"]; } } 19803->19804; 19804->19805; 19805->19806; 19806->19807; 19807->19808; 19808->19809; 19809->19810; 19810->19811; 19811->19812; 19812->19813; 19813->19814; 19814->19815; 19815->19816; 19816->19817; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time