3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 750 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 470
Associated Job Ids:
750
DAG Visualization
digraph G { subgraph clusterstage_750 { label="Stage 750"; 7879 [labelType="html" label="SQLExecutionRDD [7879]<br>run at <unknown>:0"]; 7887 [labelType="html" label="SQLExecutionRDD [7887]<br>toJavaRDD at <unknown>:0"]; 7889 [labelType="html" label="PythonRDD [7889]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster17630 { label="MicroBatchScan"; 7875 [labelType="html" label="DataSourceRDD [7875]<br>run at <unknown>:0"]; 7876 [labelType="html" label="MapPartitionsRDD [7876]<br>run at <unknown>:0"]; } subgraph cluster17629 { label="Project"; 7877 [labelType="html" label="MapPartitionsRDD [7877]<br>run at <unknown>:0"]; } subgraph cluster17625 { label="WholeStageCodegen (1)"; 7878 [labelType="html" label="MapPartitionsRDD [7878]<br>run at <unknown>:0"]; } subgraph cluster17639 { label="WholeStageCodegen (1)"; 7880 [labelType="html" label="MapPartitionsRDD [7880]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17638 { label="Filter"; 7881 [labelType="html" label="MapPartitionsRDD [7881]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17637 { label="Project"; 7882 [labelType="html" label="MapPartitionsRDD [7882]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17634 { label="WholeStageCodegen (2)"; 7883 [labelType="html" label="MapPartitionsRDD [7883]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17633 { label="Project"; 7884 [labelType="html" label="MapPartitionsRDD [7884]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17632 { label="DeserializeToObject"; 7885 [labelType="html" label="MapPartitionsRDD [7885]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17631 { label="MapPartitions"; 7886 [labelType="html" label="MapPartitionsRDD [7886]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster17641 { label="mapPartitions"; 7888 [labelType="html" label="MapPartitionsRDD [7888]<br>toJavaRDD at <unknown>:0"]; } } 7875->7876; 7876->7877; 7877->7878; 7878->7879; 7879->7880; 7880->7881; 7881->7882; 7882->7883; 7883->7884; 7884->7885; 7885->7886; 7886->7887; 7887->7888; 7888->7889; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time