3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1131 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 460
Associated Job Ids:
1132
DAG Visualization
digraph G { subgraph clusterstage_1131 { label="Stage 1131"; 11891 [labelType="html" label="SQLExecutionRDD [11891]<br>run at <unknown>:0"]; 11899 [labelType="html" label="SQLExecutionRDD [11899]<br>toJavaRDD at <unknown>:0"]; 11901 [labelType="html" label="PythonRDD [11901]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster26603 { label="MicroBatchScan"; 11887 [labelType="html" label="DataSourceRDD [11887]<br>run at <unknown>:0"]; 11888 [labelType="html" label="MapPartitionsRDD [11888]<br>run at <unknown>:0"]; } subgraph cluster26602 { label="Project"; 11889 [labelType="html" label="MapPartitionsRDD [11889]<br>run at <unknown>:0"]; } subgraph cluster26598 { label="WholeStageCodegen (1)"; 11890 [labelType="html" label="MapPartitionsRDD [11890]<br>run at <unknown>:0"]; } subgraph cluster26612 { label="WholeStageCodegen (1)"; 11892 [labelType="html" label="MapPartitionsRDD [11892]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26611 { label="Filter"; 11893 [labelType="html" label="MapPartitionsRDD [11893]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26610 { label="Project"; 11894 [labelType="html" label="MapPartitionsRDD [11894]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26607 { label="WholeStageCodegen (2)"; 11895 [labelType="html" label="MapPartitionsRDD [11895]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26606 { label="Project"; 11896 [labelType="html" label="MapPartitionsRDD [11896]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26605 { label="DeserializeToObject"; 11897 [labelType="html" label="MapPartitionsRDD [11897]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26604 { label="MapPartitions"; 11898 [labelType="html" label="MapPartitionsRDD [11898]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster26614 { label="mapPartitions"; 11900 [labelType="html" label="MapPartitionsRDD [11900]<br>toJavaRDD at <unknown>:0"]; } } 11887->11888; 11888->11889; 11889->11890; 11890->11891; 11891->11892; 11892->11893; 11893->11894; 11894->11895; 11895->11896; 11896->11897; 11897->11898; 11898->11899; 11899->11900; 11900->11901; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time