3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1384 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 494
Associated Job Ids:
1385
DAG Visualization
digraph G { subgraph clusterstage_1384 { label="Stage 1384"; 14543 [labelType="html" label="SQLExecutionRDD [14543]<br>run at <unknown>:0"]; 14551 [labelType="html" label="SQLExecutionRDD [14551]<br>toJavaRDD at <unknown>:0"]; 14553 [labelType="html" label="PythonRDD [14553]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster32533 { label="MicroBatchScan"; 14539 [labelType="html" label="DataSourceRDD [14539]<br>run at <unknown>:0"]; 14540 [labelType="html" label="MapPartitionsRDD [14540]<br>run at <unknown>:0"]; } subgraph cluster32532 { label="Project"; 14541 [labelType="html" label="MapPartitionsRDD [14541]<br>run at <unknown>:0"]; } subgraph cluster32528 { label="WholeStageCodegen (1)"; 14542 [labelType="html" label="MapPartitionsRDD [14542]<br>run at <unknown>:0"]; } subgraph cluster32542 { label="WholeStageCodegen (1)"; 14544 [labelType="html" label="MapPartitionsRDD [14544]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32541 { label="Filter"; 14545 [labelType="html" label="MapPartitionsRDD [14545]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32540 { label="Project"; 14546 [labelType="html" label="MapPartitionsRDD [14546]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32537 { label="WholeStageCodegen (2)"; 14547 [labelType="html" label="MapPartitionsRDD [14547]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32536 { label="Project"; 14548 [labelType="html" label="MapPartitionsRDD [14548]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32535 { label="DeserializeToObject"; 14549 [labelType="html" label="MapPartitionsRDD [14549]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32534 { label="MapPartitions"; 14550 [labelType="html" label="MapPartitionsRDD [14550]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster32544 { label="mapPartitions"; 14552 [labelType="html" label="MapPartitionsRDD [14552]<br>toJavaRDD at <unknown>:0"]; } } 14539->14540; 14540->14541; 14541->14542; 14542->14543; 14543->14544; 14544->14545; 14545->14546; 14546->14547; 14547->14548; 14548->14549; 14549->14550; 14550->14551; 14551->14552; 14552->14553; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time