3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 444 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 474
Associated Job Ids:
445
DAG Visualization
digraph G { subgraph clusterstage_444 { label="Stage 444"; 4673 [labelType="html" label="SQLExecutionRDD [4673]<br>run at <unknown>:0"]; 4681 [labelType="html" label="SQLExecutionRDD [4681]<br>toJavaRDD at <unknown>:0"]; 4683 [labelType="html" label="PythonRDD [4683]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster10443 { label="MicroBatchScan"; 4669 [labelType="html" label="DataSourceRDD [4669]<br>run at <unknown>:0"]; 4670 [labelType="html" label="MapPartitionsRDD [4670]<br>run at <unknown>:0"]; } subgraph cluster10442 { label="Project"; 4671 [labelType="html" label="MapPartitionsRDD [4671]<br>run at <unknown>:0"]; } subgraph cluster10438 { label="WholeStageCodegen (1)"; 4672 [labelType="html" label="MapPartitionsRDD [4672]<br>run at <unknown>:0"]; } subgraph cluster10452 { label="WholeStageCodegen (1)"; 4674 [labelType="html" label="MapPartitionsRDD [4674]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10451 { label="Filter"; 4675 [labelType="html" label="MapPartitionsRDD [4675]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10450 { label="Project"; 4676 [labelType="html" label="MapPartitionsRDD [4676]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10447 { label="WholeStageCodegen (2)"; 4677 [labelType="html" label="MapPartitionsRDD [4677]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10446 { label="Project"; 4678 [labelType="html" label="MapPartitionsRDD [4678]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10445 { label="DeserializeToObject"; 4679 [labelType="html" label="MapPartitionsRDD [4679]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10444 { label="MapPartitions"; 4680 [labelType="html" label="MapPartitionsRDD [4680]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster10454 { label="mapPartitions"; 4682 [labelType="html" label="MapPartitionsRDD [4682]<br>toJavaRDD at <unknown>:0"]; } } 4669->4670; 4670->4671; 4671->4672; 4672->4673; 4673->4674; 4674->4675; 4675->4676; 4676->4677; 4677->4678; 4678->4679; 4679->4680; 4680->4681; 4681->4682; 4682->4683; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time