3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 550 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 458
Associated Job Ids:
550
DAG Visualization
digraph G { subgraph clusterstage_550 { label="Stage 550"; 5779 [labelType="html" label="SQLExecutionRDD [5779]<br>run at <unknown>:0"]; 5787 [labelType="html" label="SQLExecutionRDD [5787]<br>toJavaRDD at <unknown>:0"]; 5789 [labelType="html" label="PythonRDD [5789]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster12930 { label="MicroBatchScan"; 5775 [labelType="html" label="DataSourceRDD [5775]<br>run at <unknown>:0"]; 5776 [labelType="html" label="MapPartitionsRDD [5776]<br>run at <unknown>:0"]; } subgraph cluster12929 { label="Project"; 5777 [labelType="html" label="MapPartitionsRDD [5777]<br>run at <unknown>:0"]; } subgraph cluster12925 { label="WholeStageCodegen (1)"; 5778 [labelType="html" label="MapPartitionsRDD [5778]<br>run at <unknown>:0"]; } subgraph cluster12939 { label="WholeStageCodegen (1)"; 5780 [labelType="html" label="MapPartitionsRDD [5780]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12938 { label="Filter"; 5781 [labelType="html" label="MapPartitionsRDD [5781]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12937 { label="Project"; 5782 [labelType="html" label="MapPartitionsRDD [5782]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12934 { label="WholeStageCodegen (2)"; 5783 [labelType="html" label="MapPartitionsRDD [5783]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12933 { label="Project"; 5784 [labelType="html" label="MapPartitionsRDD [5784]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12932 { label="DeserializeToObject"; 5785 [labelType="html" label="MapPartitionsRDD [5785]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12931 { label="MapPartitions"; 5786 [labelType="html" label="MapPartitionsRDD [5786]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster12941 { label="mapPartitions"; 5788 [labelType="html" label="MapPartitionsRDD [5788]<br>toJavaRDD at <unknown>:0"]; } } 5775->5776; 5776->5777; 5777->5778; 5778->5779; 5779->5780; 5780->5781; 5781->5782; 5782->5783; 5783->5784; 5784->5785; 5785->5786; 5786->5787; 5787->5788; 5788->5789; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time