3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 944 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 430
Associated Job Ids:
944
DAG Visualization
digraph G { subgraph clusterstage_944 { label="Stage 944"; 9916 [labelType="html" label="SQLExecutionRDD [9916]<br>run at <unknown>:0"]; 9924 [labelType="html" label="SQLExecutionRDD [9924]<br>toJavaRDD at <unknown>:0"]; 9926 [labelType="html" label="PythonRDD [9926]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster22189 { label="MicroBatchScan"; 9912 [labelType="html" label="DataSourceRDD [9912]<br>run at <unknown>:0"]; 9913 [labelType="html" label="MapPartitionsRDD [9913]<br>run at <unknown>:0"]; } subgraph cluster22188 { label="Project"; 9914 [labelType="html" label="MapPartitionsRDD [9914]<br>run at <unknown>:0"]; } subgraph cluster22184 { label="WholeStageCodegen (1)"; 9915 [labelType="html" label="MapPartitionsRDD [9915]<br>run at <unknown>:0"]; } subgraph cluster22198 { label="WholeStageCodegen (1)"; 9917 [labelType="html" label="MapPartitionsRDD [9917]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22197 { label="Filter"; 9918 [labelType="html" label="MapPartitionsRDD [9918]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22196 { label="Project"; 9919 [labelType="html" label="MapPartitionsRDD [9919]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22193 { label="WholeStageCodegen (2)"; 9920 [labelType="html" label="MapPartitionsRDD [9920]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22192 { label="Project"; 9921 [labelType="html" label="MapPartitionsRDD [9921]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22191 { label="DeserializeToObject"; 9922 [labelType="html" label="MapPartitionsRDD [9922]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22190 { label="MapPartitions"; 9923 [labelType="html" label="MapPartitionsRDD [9923]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster22200 { label="mapPartitions"; 9925 [labelType="html" label="MapPartitionsRDD [9925]<br>toJavaRDD at <unknown>:0"]; } } 9912->9913; 9913->9914; 9914->9915; 9915->9916; 9916->9917; 9917->9918; 9918->9919; 9919->9920; 9920->9921; 9921->9922; 9922->9923; 9923->9924; 9924->9925; 9925->9926; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time