3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 761 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 452
Associated Job Ids:
761
DAG Visualization
digraph G { subgraph clusterstage_761 { label="Stage 761"; 7984 [labelType="html" label="SQLExecutionRDD [7984]<br>run at <unknown>:0"]; 7998 [labelType="html" label="SQLExecutionRDD [7998]<br>toJavaRDD at <unknown>:0"]; 8000 [labelType="html" label="PythonRDD [8000]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17865 { label="MicroBatchScan"; 7980 [labelType="html" label="DataSourceRDD [7980]<br>run at <unknown>:0"]; 7981 [labelType="html" label="MapPartitionsRDD [7981]<br>run at <unknown>:0"]; } subgraph cluster17864 { label="Project"; 7982 [labelType="html" label="MapPartitionsRDD [7982]<br>run at <unknown>:0"]; } subgraph cluster17860 { label="WholeStageCodegen (1)"; 7983 [labelType="html" label="MapPartitionsRDD [7983]<br>run at <unknown>:0"]; } subgraph cluster17882 { label="WholeStageCodegen (1)"; 7991 [labelType="html" label="MapPartitionsRDD [7991]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17881 { label="Filter"; 7992 [labelType="html" label="MapPartitionsRDD [7992]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17880 { label="Project"; 7993 [labelType="html" label="MapPartitionsRDD [7993]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17877 { label="WholeStageCodegen (2)"; 7994 [labelType="html" label="MapPartitionsRDD [7994]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17876 { label="Project"; 7995 [labelType="html" label="MapPartitionsRDD [7995]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17875 { label="DeserializeToObject"; 7996 [labelType="html" label="MapPartitionsRDD [7996]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17874 { label="MapPartitions"; 7997 [labelType="html" label="MapPartitionsRDD [7997]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17884 { label="mapPartitions"; 7999 [labelType="html" label="MapPartitionsRDD [7999]<br>toJavaRDD at <unknown>:0"]; } } 7980->7981; 7981->7982; 7982->7983; 7983->7984; 7984->7991; 7991->7992; 7992->7993; 7993->7994; 7994->7995; 7995->7996; 7996->7997; 7997->7998; 7998->7999; 7999->8000; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time