3.5.2
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
JDBC/ODBC Server
Thrift JDBC/ODBC Server
application UI
Details for Stage 54 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
49 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
2.2 MiB / 46236
Associated Job Ids:
40
DAG Visualization
digraph G { subgraph clusterstage_54 { label="Stage 54"; subgraph cluster424 { label="Scan parquet spark_catalog.default.airports"; 168 [labelType="html" label="FileScanRDD [168]<br>run at AccessController.java:0"]; 169 [labelType="html" label="MapPartitionsRDD [169]<br>run at AccessController.java:0"]; } subgraph cluster419 { label="WholeStageCodegen (1)"; 170 [labelType="html" label="MapPartitionsRDD [170]<br>run at AccessController.java:0"]; } subgraph cluster418 { label="TakeOrderedAndProject"; 171 [labelType="html" label="MapPartitionsRDD [171]<br>run at AccessController.java:0"]; 172 [labelType="html" label="MapPartitionsRDD [172]<br>run at AccessController.java:0"]; } } 168->169; 169->170; 170->171; 171->172; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time