3.5.8
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
processing-stream-kafka-raw-to-m...
application UI
Details for Stage 147 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 3
Input Size / Records:
0.0 B / 518
Associated Job Ids:
147
DAG Visualization
digraph G { subgraph clusterstage_147 { label="Stage 147"; 1543 [labelType="html" label="SQLExecutionRDD [1543]<br>run at <unknown>:0"]; 1551 [labelType="html" label="SQLExecutionRDD [1551]<br>toJavaRDD at <unknown>:0"]; 1553 [labelType="html" label="PythonRDD [1553]<br>call at /opt/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/clientserver.py:617"]; subgraph cluster3444 { label="MicroBatchScan"; 1539 [labelType="html" label="DataSourceRDD [1539]<br>run at <unknown>:0"]; 1540 [labelType="html" label="MapPartitionsRDD [1540]<br>run at <unknown>:0"]; } subgraph cluster3443 { label="Project"; 1541 [labelType="html" label="MapPartitionsRDD [1541]<br>run at <unknown>:0"]; } subgraph cluster3439 { label="WholeStageCodegen (1)"; 1542 [labelType="html" label="MapPartitionsRDD [1542]<br>run at <unknown>:0"]; } subgraph cluster3453 { label="WholeStageCodegen (1)"; 1544 [labelType="html" label="MapPartitionsRDD [1544]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3452 { label="Filter"; 1545 [labelType="html" label="MapPartitionsRDD [1545]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3451 { label="Project"; 1546 [labelType="html" label="MapPartitionsRDD [1546]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3448 { label="WholeStageCodegen (2)"; 1547 [labelType="html" label="MapPartitionsRDD [1547]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3447 { label="Project"; 1548 [labelType="html" label="MapPartitionsRDD [1548]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3446 { label="DeserializeToObject"; 1549 [labelType="html" label="MapPartitionsRDD [1549]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3445 { label="MapPartitions"; 1550 [labelType="html" label="MapPartitionsRDD [1550]<br>toJavaRDD at <unknown>:0"]; } subgraph cluster3455 { label="mapPartitions"; 1552 [labelType="html" label="MapPartitionsRDD [1552]<br>toJavaRDD at <unknown>:0"]; } } 1539->1540; 1540->1541; 1541->1542; 1542->1543; 1543->1544; 1544->1545; 1545->1546; 1546->1547; 1547->1548; 1548->1549; 1549->1550; 1550->1551; 1551->1552; 1552->1553; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time