3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 666 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 524
Associated Job Ids:
666
DAG Visualization
digraph G { subgraph clusterstage_666 { label="Stage 666"; 6997 [labelType="html" label="SQLExecutionRDD [6997]<br>run at <unknown>:0"]; 7005 [labelType="html" label="SQLExecutionRDD [7005]<br>toJavaRDD at <unknown>:0"]; 7007 [labelType="html" label="PythonRDD [7007]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster15656 { label="MicroBatchScan"; 6993 [labelType="html" label="DataSourceRDD [6993]<br>run at <unknown>:0"]; 6994 [labelType="html" label="MapPartitionsRDD [6994]<br>run at <unknown>:0"]; } subgraph cluster15655 { label="Project"; 6995 [labelType="html" label="MapPartitionsRDD [6995]<br>run at <unknown>:0"]; } subgraph cluster15651 { label="WholeStageCodegen (1)"; 6996 [labelType="html" label="MapPartitionsRDD [6996]<br>run at <unknown>:0"]; } subgraph cluster15665 { label="WholeStageCodegen (1)"; 6998 [labelType="html" label="MapPartitionsRDD [6998]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15664 { label="Filter"; 6999 [labelType="html" label="MapPartitionsRDD [6999]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15663 { label="Project"; 7000 [labelType="html" label="MapPartitionsRDD [7000]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15660 { label="WholeStageCodegen (2)"; 7001 [labelType="html" label="MapPartitionsRDD [7001]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15659 { label="Project"; 7002 [labelType="html" label="MapPartitionsRDD [7002]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15658 { label="DeserializeToObject"; 7003 [labelType="html" label="MapPartitionsRDD [7003]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15657 { label="MapPartitions"; 7004 [labelType="html" label="MapPartitionsRDD [7004]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster15667 { label="mapPartitions"; 7006 [labelType="html" label="MapPartitionsRDD [7006]<br>toJavaRDD at <unknown>:0"]; } } 6993->6994; 6994->6995; 6995->6996; 6996->6997; 6997->6998; 6998->6999; 6999->7000; 7000->7001; 7001->7002; 7002->7003; 7003->7004; 7004->7005; 7005->7006; 7006->7007; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time