3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 63 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 411
Associated Job Ids:
63
DAG Visualization
digraph G { subgraph clusterstage_63 { label="Stage 63"; 655 [labelType="html" label="SQLExecutionRDD [655]<br>run at <unknown>:0"]; 669 [labelType="html" label="SQLExecutionRDD [669]<br>toJavaRDD at <unknown>:0"]; 671 [labelType="html" label="PythonRDD [671]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster1462 { label="MicroBatchScan"; 651 [labelType="html" label="DataSourceRDD [651]<br>run at <unknown>:0"]; 652 [labelType="html" label="MapPartitionsRDD [652]<br>run at <unknown>:0"]; } subgraph cluster1461 { label="Project"; 653 [labelType="html" label="MapPartitionsRDD [653]<br>run at <unknown>:0"]; } subgraph cluster1457 { label="WholeStageCodegen (1)"; 654 [labelType="html" label="MapPartitionsRDD [654]<br>run at <unknown>:0"]; } subgraph cluster1479 { label="WholeStageCodegen (1)"; 662 [labelType="html" label="MapPartitionsRDD [662]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1478 { label="Filter"; 663 [labelType="html" label="MapPartitionsRDD [663]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1477 { label="Project"; 664 [labelType="html" label="MapPartitionsRDD [664]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1474 { label="WholeStageCodegen (2)"; 665 [labelType="html" label="MapPartitionsRDD [665]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1473 { label="Project"; 666 [labelType="html" label="MapPartitionsRDD [666]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1472 { label="DeserializeToObject"; 667 [labelType="html" label="MapPartitionsRDD [667]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1471 { label="MapPartitions"; 668 [labelType="html" label="MapPartitionsRDD [668]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster1481 { label="mapPartitions"; 670 [labelType="html" label="MapPartitionsRDD [670]<br>toJavaRDD at <unknown>:0"]; } } 651->652; 652->653; 653->654; 654->655; 655->662; 662->663; 663->664; 664->665; 665->666; 666->667; 667->668; 668->669; 669->670; 670->671; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time