3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 701 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 461
Associated Job Ids:
702
DAG Visualization
digraph G { subgraph clusterstage_701 { label="Stage 701"; 7376 [labelType="html" label="SQLExecutionRDD [7376]<br>run at <unknown>:0"]; 7384 [labelType="html" label="SQLExecutionRDD [7384]<br>toJavaRDD at <unknown>:0"]; 7386 [labelType="html" label="PythonRDD [7386]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster16498 { label="MicroBatchScan"; 7372 [labelType="html" label="DataSourceRDD [7372]<br>run at <unknown>:0"]; 7373 [labelType="html" label="MapPartitionsRDD [7373]<br>run at <unknown>:0"]; } subgraph cluster16497 { label="Project"; 7374 [labelType="html" label="MapPartitionsRDD [7374]<br>run at <unknown>:0"]; } subgraph cluster16493 { label="WholeStageCodegen (1)"; 7375 [labelType="html" label="MapPartitionsRDD [7375]<br>run at <unknown>:0"]; } subgraph cluster16507 { label="WholeStageCodegen (1)"; 7377 [labelType="html" label="MapPartitionsRDD [7377]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16506 { label="Filter"; 7378 [labelType="html" label="MapPartitionsRDD [7378]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16505 { label="Project"; 7379 [labelType="html" label="MapPartitionsRDD [7379]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16502 { label="WholeStageCodegen (2)"; 7380 [labelType="html" label="MapPartitionsRDD [7380]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16501 { label="Project"; 7381 [labelType="html" label="MapPartitionsRDD [7381]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16500 { label="DeserializeToObject"; 7382 [labelType="html" label="MapPartitionsRDD [7382]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16499 { label="MapPartitions"; 7383 [labelType="html" label="MapPartitionsRDD [7383]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster16509 { label="mapPartitions"; 7385 [labelType="html" label="MapPartitionsRDD [7385]<br>toJavaRDD at <unknown>:0"]; } } 7372->7373; 7373->7374; 7374->7375; 7375->7376; 7376->7377; 7377->7378; 7378->7379; 7379->7380; 7380->7381; 7381->7382; 7382->7383; 7383->7384; 7384->7385; 7385->7386; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time