3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 186 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 529
Associated Job Ids:
186
DAG Visualization
digraph G { subgraph clusterstage_186 { label="Stage 186"; 1957 [labelType="html" label="SQLExecutionRDD [1957]<br>run at <unknown>:0"]; 1965 [labelType="html" label="SQLExecutionRDD [1965]<br>toJavaRDD at <unknown>:0"]; 1967 [labelType="html" label="PythonRDD [1967]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster4376 { label="MicroBatchScan"; 1953 [labelType="html" label="DataSourceRDD [1953]<br>run at <unknown>:0"]; 1954 [labelType="html" label="MapPartitionsRDD [1954]<br>run at <unknown>:0"]; } subgraph cluster4375 { label="Project"; 1955 [labelType="html" label="MapPartitionsRDD [1955]<br>run at <unknown>:0"]; } subgraph cluster4371 { label="WholeStageCodegen (1)"; 1956 [labelType="html" label="MapPartitionsRDD [1956]<br>run at <unknown>:0"]; } subgraph cluster4385 { label="WholeStageCodegen (1)"; 1958 [labelType="html" label="MapPartitionsRDD [1958]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4384 { label="Filter"; 1959 [labelType="html" label="MapPartitionsRDD [1959]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4383 { label="Project"; 1960 [labelType="html" label="MapPartitionsRDD [1960]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4380 { label="WholeStageCodegen (2)"; 1961 [labelType="html" label="MapPartitionsRDD [1961]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4379 { label="Project"; 1962 [labelType="html" label="MapPartitionsRDD [1962]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4378 { label="DeserializeToObject"; 1963 [labelType="html" label="MapPartitionsRDD [1963]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4377 { label="MapPartitions"; 1964 [labelType="html" label="MapPartitionsRDD [1964]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster4387 { label="mapPartitions"; 1966 [labelType="html" label="MapPartitionsRDD [1966]<br>toJavaRDD at <unknown>:0"]; } } 1953->1954; 1954->1955; 1955->1956; 1956->1957; 1957->1958; 1958->1959; 1959->1960; 1960->1961; 1961->1962; 1962->1963; 1963->1964; 1964->1965; 1965->1966; 1966->1967; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time