3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 274 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 4
Input Size / Records:
0.0 B / 360
Associated Job Ids:
274
DAG Visualization
digraph G { subgraph clusterstage_274 { label="Stage 274"; 2881 [labelType="html" label="SQLExecutionRDD [2881]<br>run at <unknown>:0"]; 2889 [labelType="html" label="SQLExecutionRDD [2889]<br>toJavaRDD at <unknown>:0"]; 2891 [labelType="html" label="PythonRDD [2891]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster6444 { label="MicroBatchScan"; 2877 [labelType="html" label="DataSourceRDD [2877]<br>run at <unknown>:0"]; 2878 [labelType="html" label="MapPartitionsRDD [2878]<br>run at <unknown>:0"]; } subgraph cluster6443 { label="Project"; 2879 [labelType="html" label="MapPartitionsRDD [2879]<br>run at <unknown>:0"]; } subgraph cluster6439 { label="WholeStageCodegen (1)"; 2880 [labelType="html" label="MapPartitionsRDD [2880]<br>run at <unknown>:0"]; } subgraph cluster6453 { label="WholeStageCodegen (1)"; 2882 [labelType="html" label="MapPartitionsRDD [2882]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6452 { label="Filter"; 2883 [labelType="html" label="MapPartitionsRDD [2883]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6451 { label="Project"; 2884 [labelType="html" label="MapPartitionsRDD [2884]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6448 { label="WholeStageCodegen (2)"; 2885 [labelType="html" label="MapPartitionsRDD [2885]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6447 { label="Project"; 2886 [labelType="html" label="MapPartitionsRDD [2886]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6446 { label="DeserializeToObject"; 2887 [labelType="html" label="MapPartitionsRDD [2887]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6445 { label="MapPartitions"; 2888 [labelType="html" label="MapPartitionsRDD [2888]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster6455 { label="mapPartitions"; 2890 [labelType="html" label="MapPartitionsRDD [2890]<br>toJavaRDD at <unknown>:0"]; } } 2877->2878; 2878->2879; 2879->2880; 2880->2881; 2881->2882; 2882->2883; 2883->2884; 2884->2885; 2885->2886; 2886->2887; 2887->2888; 2888->2889; 2889->2890; 2890->2891; }
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time