3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 361 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 530
Associated Job Ids:
361
DAG Visualization
digraph G { subgraph clusterstage_361 { label="Stage 361"; 3790 [labelType="html" label="SQLExecutionRDD [3790]<br>run at <unknown>:0"]; 3798 [labelType="html" label="SQLExecutionRDD [3798]<br>toJavaRDD at <unknown>:0"]; 3800 [labelType="html" label="PythonRDD [3800]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster8473 { label="MicroBatchScan"; 3781 [labelType="html" label="DataSourceRDD [3781]<br>run at <unknown>:0"]; 3784 [labelType="html" label="MapPartitionsRDD [3784]<br>run at <unknown>:0"]; } subgraph cluster8472 { label="Project"; 3785 [labelType="html" label="MapPartitionsRDD [3785]<br>run at <unknown>:0"]; } subgraph cluster8466 { label="WholeStageCodegen (1)"; 3789 [labelType="html" label="MapPartitionsRDD [3789]<br>run at <unknown>:0"]; } subgraph cluster8482 { label="WholeStageCodegen (1)"; 3791 [labelType="html" label="MapPartitionsRDD [3791]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8481 { label="Filter"; 3792 [labelType="html" label="MapPartitionsRDD [3792]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8480 { label="Project"; 3793 [labelType="html" label="MapPartitionsRDD [3793]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8477 { label="WholeStageCodegen (2)"; 3794 [labelType="html" label="MapPartitionsRDD [3794]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8476 { label="Project"; 3795 [labelType="html" label="MapPartitionsRDD [3795]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8475 { label="DeserializeToObject"; 3796 [labelType="html" label="MapPartitionsRDD [3796]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8474 { label="MapPartitions"; 3797 [labelType="html" label="MapPartitionsRDD [3797]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster8484 { label="mapPartitions"; 3799 [labelType="html" label="MapPartitionsRDD [3799]<br>toJavaRDD at <unknown>:0"]; } } 3781->3784; 3784->3785; 3785->3789; 3789->3790; 3790->3791; 3791->3792; 3792->3793; 3793->3794; 3794->3795; 3795->3796; 3796->3797; 3797->3798; 3798->3799; 3799->3800; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time