3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 926 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 503
Associated Job Ids:
926
DAG Visualization
digraph G { subgraph clusterstage_926 { label="Stage 926"; 9727 [labelType="html" label="SQLExecutionRDD [9727]<br>run at <unknown>:0"]; 9735 [labelType="html" label="SQLExecutionRDD [9735]<br>toJavaRDD at <unknown>:0"]; 9737 [labelType="html" label="PythonRDD [9737]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster21766 { label="MicroBatchScan"; 9723 [labelType="html" label="DataSourceRDD [9723]<br>run at <unknown>:0"]; 9724 [labelType="html" label="MapPartitionsRDD [9724]<br>run at <unknown>:0"]; } subgraph cluster21765 { label="Project"; 9725 [labelType="html" label="MapPartitionsRDD [9725]<br>run at <unknown>:0"]; } subgraph cluster21761 { label="WholeStageCodegen (1)"; 9726 [labelType="html" label="MapPartitionsRDD [9726]<br>run at <unknown>:0"]; } subgraph cluster21775 { label="WholeStageCodegen (1)"; 9728 [labelType="html" label="MapPartitionsRDD [9728]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21774 { label="Filter"; 9729 [labelType="html" label="MapPartitionsRDD [9729]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21773 { label="Project"; 9730 [labelType="html" label="MapPartitionsRDD [9730]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21770 { label="WholeStageCodegen (2)"; 9731 [labelType="html" label="MapPartitionsRDD [9731]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21769 { label="Project"; 9732 [labelType="html" label="MapPartitionsRDD [9732]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21768 { label="DeserializeToObject"; 9733 [labelType="html" label="MapPartitionsRDD [9733]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21767 { label="MapPartitions"; 9734 [labelType="html" label="MapPartitionsRDD [9734]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster21777 { label="mapPartitions"; 9736 [labelType="html" label="MapPartitionsRDD [9736]<br>toJavaRDD at <unknown>:0"]; } } 9723->9724; 9724->9725; 9725->9726; 9726->9727; 9727->9728; 9728->9729; 9729->9730; 9730->9731; 9731->9732; 9732->9733; 9733->9734; 9734->9735; 9735->9736; 9736->9737; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time