3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1133 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 489
Associated Job Ids:
1134
DAG Visualization
digraph G { subgraph clusterstage_1133 { label="Stage 1133"; 11912 [labelType="html" label="SQLExecutionRDD [11912]<br>run at <unknown>:0"]; 11920 [labelType="html" label="SQLExecutionRDD [11920]<br>toJavaRDD at <unknown>:0"]; 11922 [labelType="html" label="PythonRDD [11922]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26650 { label="MicroBatchScan"; 11908 [labelType="html" label="DataSourceRDD [11908]<br>run at <unknown>:0"]; 11909 [labelType="html" label="MapPartitionsRDD [11909]<br>run at <unknown>:0"]; } subgraph cluster26649 { label="Project"; 11910 [labelType="html" label="MapPartitionsRDD [11910]<br>run at <unknown>:0"]; } subgraph cluster26645 { label="WholeStageCodegen (1)"; 11911 [labelType="html" label="MapPartitionsRDD [11911]<br>run at <unknown>:0"]; } subgraph cluster26659 { label="WholeStageCodegen (1)"; 11913 [labelType="html" label="MapPartitionsRDD [11913]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26658 { label="Filter"; 11914 [labelType="html" label="MapPartitionsRDD [11914]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26657 { label="Project"; 11915 [labelType="html" label="MapPartitionsRDD [11915]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26654 { label="WholeStageCodegen (2)"; 11916 [labelType="html" label="MapPartitionsRDD [11916]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26653 { label="Project"; 11917 [labelType="html" label="MapPartitionsRDD [11917]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26652 { label="DeserializeToObject"; 11918 [labelType="html" label="MapPartitionsRDD [11918]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26651 { label="MapPartitions"; 11919 [labelType="html" label="MapPartitionsRDD [11919]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26661 { label="mapPartitions"; 11921 [labelType="html" label="MapPartitionsRDD [11921]<br>toJavaRDD at <unknown>:0"]; } } 11908->11909; 11909->11910; 11910->11911; 11911->11912; 11912->11913; 11913->11914; 11914->11915; 11915->11916; 11916->11917; 11917->11918; 11918->11919; 11919->11920; 11920->11921; 11921->11922; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time