3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 1860 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 494
Associated Job Ids:
1860
DAG Visualization
digraph G { subgraph clusterstage_1860 { label="Stage 1860"; 19534 [labelType="html" label="SQLExecutionRDD [19534]<br>run at <unknown>:0"]; 19542 [labelType="html" label="SQLExecutionRDD [19542]<br>toJavaRDD at <unknown>:0"]; 19544 [labelType="html" label="PythonRDD [19544]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster43715 { label="MicroBatchScan"; 19530 [labelType="html" label="DataSourceRDD [19530]<br>run at <unknown>:0"]; 19531 [labelType="html" label="MapPartitionsRDD [19531]<br>run at <unknown>:0"]; } subgraph cluster43714 { label="Project"; 19532 [labelType="html" label="MapPartitionsRDD [19532]<br>run at <unknown>:0"]; } subgraph cluster43710 { label="WholeStageCodegen (1)"; 19533 [labelType="html" label="MapPartitionsRDD [19533]<br>run at <unknown>:0"]; } subgraph cluster43724 { label="WholeStageCodegen (1)"; 19535 [labelType="html" label="MapPartitionsRDD [19535]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43723 { label="Filter"; 19536 [labelType="html" label="MapPartitionsRDD [19536]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43722 { label="Project"; 19537 [labelType="html" label="MapPartitionsRDD [19537]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43719 { label="WholeStageCodegen (2)"; 19538 [labelType="html" label="MapPartitionsRDD [19538]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43718 { label="Project"; 19539 [labelType="html" label="MapPartitionsRDD [19539]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43717 { label="DeserializeToObject"; 19540 [labelType="html" label="MapPartitionsRDD [19540]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43716 { label="MapPartitions"; 19541 [labelType="html" label="MapPartitionsRDD [19541]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster43726 { label="mapPartitions"; 19543 [labelType="html" label="MapPartitionsRDD [19543]<br>toJavaRDD at <unknown>:0"]; } } 19530->19531; 19531->19532; 19532->19533; 19533->19534; 19534->19535; 19535->19536; 19536->19537; 19537->19538; 19538->19539; 19539->19540; 19540->19541; 19541->19542; 19542->19543; 19543->19544; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time