3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1849 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 432
Associated Job Ids:
1849
DAG Visualization
digraph G { subgraph clusterstage_1849 { label="Stage 1849"; 19414 [labelType="html" label="SQLExecutionRDD [19414]<br>run at <unknown>:0"]; 19422 [labelType="html" label="SQLExecutionRDD [19422]<br>toJavaRDD at <unknown>:0"]; 19424 [labelType="html" label="PythonRDD [19424]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43441 { label="MicroBatchScan"; 19410 [labelType="html" label="DataSourceRDD [19410]<br>run at <unknown>:0"]; 19411 [labelType="html" label="MapPartitionsRDD [19411]<br>run at <unknown>:0"]; } subgraph cluster43440 { label="Project"; 19412 [labelType="html" label="MapPartitionsRDD [19412]<br>run at <unknown>:0"]; } subgraph cluster43436 { label="WholeStageCodegen (1)"; 19413 [labelType="html" label="MapPartitionsRDD [19413]<br>run at <unknown>:0"]; } subgraph cluster43450 { label="WholeStageCodegen (1)"; 19415 [labelType="html" label="MapPartitionsRDD [19415]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43449 { label="Filter"; 19416 [labelType="html" label="MapPartitionsRDD [19416]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43448 { label="Project"; 19417 [labelType="html" label="MapPartitionsRDD [19417]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43445 { label="WholeStageCodegen (2)"; 19418 [labelType="html" label="MapPartitionsRDD [19418]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43444 { label="Project"; 19419 [labelType="html" label="MapPartitionsRDD [19419]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43443 { label="DeserializeToObject"; 19420 [labelType="html" label="MapPartitionsRDD [19420]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43442 { label="MapPartitions"; 19421 [labelType="html" label="MapPartitionsRDD [19421]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43452 { label="mapPartitions"; 19423 [labelType="html" label="MapPartitionsRDD [19423]<br>toJavaRDD at <unknown>:0"]; } } 19410->19411; 19411->19412; 19412->19413; 19413->19414; 19414->19415; 19415->19416; 19416->19417; 19417->19418; 19418->19419; 19419->19420; 19420->19421; 19421->19422; 19422->19423; 19423->19424; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time