3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1939 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 365
Associated Job Ids:
1940
DAG Visualization
digraph G { subgraph clusterstage_1939 { label="Stage 1939"; 20375 [labelType="html" label="SQLExecutionRDD [20375]<br>run at <unknown>:0"]; 20383 [labelType="html" label="SQLExecutionRDD [20383]<br>toJavaRDD at <unknown>:0"]; 20385 [labelType="html" label="PythonRDD [20385]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster45591 { label="MicroBatchScan"; 20371 [labelType="html" label="DataSourceRDD [20371]<br>run at <unknown>:0"]; 20372 [labelType="html" label="MapPartitionsRDD [20372]<br>run at <unknown>:0"]; } subgraph cluster45590 { label="Project"; 20373 [labelType="html" label="MapPartitionsRDD [20373]<br>run at <unknown>:0"]; } subgraph cluster45586 { label="WholeStageCodegen (1)"; 20374 [labelType="html" label="MapPartitionsRDD [20374]<br>run at <unknown>:0"]; } subgraph cluster45600 { label="WholeStageCodegen (1)"; 20376 [labelType="html" label="MapPartitionsRDD [20376]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45599 { label="Filter"; 20377 [labelType="html" label="MapPartitionsRDD [20377]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45598 { label="Project"; 20378 [labelType="html" label="MapPartitionsRDD [20378]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45595 { label="WholeStageCodegen (2)"; 20379 [labelType="html" label="MapPartitionsRDD [20379]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45594 { label="Project"; 20380 [labelType="html" label="MapPartitionsRDD [20380]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45593 { label="DeserializeToObject"; 20381 [labelType="html" label="MapPartitionsRDD [20381]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45592 { label="MapPartitions"; 20382 [labelType="html" label="MapPartitionsRDD [20382]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster45602 { label="mapPartitions"; 20384 [labelType="html" label="MapPartitionsRDD [20384]<br>toJavaRDD at <unknown>:0"]; } } 20371->20372; 20372->20373; 20373->20374; 20374->20375; 20375->20376; 20376->20377; 20377->20378; 20378->20379; 20379->20380; 20380->20381; 20381->20382; 20382->20383; 20383->20384; 20384->20385; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time