3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 230 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 392
Associated Job Ids:
230
DAG Visualization
digraph G { subgraph clusterstage_230 { label="Stage 230"; 2419 [labelType="html" label="SQLExecutionRDD [2419]<br>run at <unknown>:0"]; 2427 [labelType="html" label="SQLExecutionRDD [2427]<br>toJavaRDD at <unknown>:0"]; 2429 [labelType="html" label="PythonRDD [2429]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster5410 { label="MicroBatchScan"; 2415 [labelType="html" label="DataSourceRDD [2415]<br>run at <unknown>:0"]; 2416 [labelType="html" label="MapPartitionsRDD [2416]<br>run at <unknown>:0"]; } subgraph cluster5409 { label="Project"; 2417 [labelType="html" label="MapPartitionsRDD [2417]<br>run at <unknown>:0"]; } subgraph cluster5405 { label="WholeStageCodegen (1)"; 2418 [labelType="html" label="MapPartitionsRDD [2418]<br>run at <unknown>:0"]; } subgraph cluster5419 { label="WholeStageCodegen (1)"; 2420 [labelType="html" label="MapPartitionsRDD [2420]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5418 { label="Filter"; 2421 [labelType="html" label="MapPartitionsRDD [2421]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5417 { label="Project"; 2422 [labelType="html" label="MapPartitionsRDD [2422]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5414 { label="WholeStageCodegen (2)"; 2423 [labelType="html" label="MapPartitionsRDD [2423]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5413 { label="Project"; 2424 [labelType="html" label="MapPartitionsRDD [2424]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5412 { label="DeserializeToObject"; 2425 [labelType="html" label="MapPartitionsRDD [2425]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5411 { label="MapPartitions"; 2426 [labelType="html" label="MapPartitionsRDD [2426]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster5421 { label="mapPartitions"; 2428 [labelType="html" label="MapPartitionsRDD [2428]<br>toJavaRDD at <unknown>:0"]; } } 2415->2416; 2416->2417; 2417->2418; 2418->2419; 2419->2420; 2420->2421; 2421->2422; 2422->2423; 2423->2424; 2424->2425; 2425->2426; 2426->2427; 2427->2428; 2428->2429; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time