3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1743 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 501
Associated Job Ids:
1743
DAG Visualization
digraph G { subgraph clusterstage_1743 { label="Stage 1743"; 18295 [labelType="html" label="SQLExecutionRDD [18295]<br>run at <unknown>:0"]; 18309 [labelType="html" label="SQLExecutionRDD [18309]<br>toJavaRDD at <unknown>:0"]; 18311 [labelType="html" label="PythonRDD [18311]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster40942 { label="MicroBatchScan"; 18291 [labelType="html" label="DataSourceRDD [18291]<br>run at <unknown>:0"]; 18292 [labelType="html" label="MapPartitionsRDD [18292]<br>run at <unknown>:0"]; } subgraph cluster40941 { label="Project"; 18293 [labelType="html" label="MapPartitionsRDD [18293]<br>run at <unknown>:0"]; } subgraph cluster40937 { label="WholeStageCodegen (1)"; 18294 [labelType="html" label="MapPartitionsRDD [18294]<br>run at <unknown>:0"]; } subgraph cluster40959 { label="WholeStageCodegen (1)"; 18302 [labelType="html" label="MapPartitionsRDD [18302]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40958 { label="Filter"; 18303 [labelType="html" label="MapPartitionsRDD [18303]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40957 { label="Project"; 18304 [labelType="html" label="MapPartitionsRDD [18304]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40954 { label="WholeStageCodegen (2)"; 18305 [labelType="html" label="MapPartitionsRDD [18305]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40953 { label="Project"; 18306 [labelType="html" label="MapPartitionsRDD [18306]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40952 { label="DeserializeToObject"; 18307 [labelType="html" label="MapPartitionsRDD [18307]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40951 { label="MapPartitions"; 18308 [labelType="html" label="MapPartitionsRDD [18308]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster40961 { label="mapPartitions"; 18310 [labelType="html" label="MapPartitionsRDD [18310]<br>toJavaRDD at <unknown>:0"]; } } 18291->18292; 18292->18293; 18293->18294; 18294->18295; 18295->18302; 18302->18303; 18303->18304; 18304->18305; 18305->18306; 18306->18307; 18307->18308; 18308->18309; 18309->18310; 18310->18311; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time