== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4138, value#4139, meaning#4140, Since version#4141], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4138, value#4139, meaning#4140, Since version#4141]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4190, data_type#4191, comment#4192]
+- 'UnresolvedTableOrView [default, alltypes], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`alltypes`, false, [col_name#4190, data_type#4191, comment#4192]

== Optimized Logical Plan ==
CommandResult [col_name#4190, data_type#4191, comment#4192], Execute DescribeTableCommand, [[STRING,string,null], [DOUBLE,double,null], [INTEGER,int,null], [BIGINT,bigint,null], [FLOAT,float,null], [DECIMAL,decimal(10,2),null], [NUMBER,decimal(10,2),null], [BOOLEAN,boolean,null], [DATE,date,null], [TIMESTAMP,timestamp,null], [DATETIME,timestamp,null], [BINARY,binary,null], [ARRAY,array<int>,null], [MAP,map<string,string>,null], [STRUCT,struct<field1:string,field2:int>,null], [VARCHAR,string,null], [CHAR,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`alltypes`, false, [col_name#4190, data_type#4191, comment#4192]

== Physical Plan ==
CommandResult [col_name#4190, data_type#4191, comment#4192]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`alltypes`, false, [col_name#4190, data_type#4191, comment#4192]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4163, data_type#4164, comment#4165]
+- 'UnresolvedTableOrView [default, alltypes], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`alltypes`, false, [col_name#4163, data_type#4164, comment#4165]

== Optimized Logical Plan ==
CommandResult [col_name#4163, data_type#4164, comment#4165], Execute DescribeTableCommand, [[STRING,string,null], [DOUBLE,double,null], [INTEGER,int,null], [BIGINT,bigint,null], [FLOAT,float,null], [DECIMAL,decimal(10,2),null], [NUMBER,decimal(10,2),null], [BOOLEAN,boolean,null], [DATE,date,null], [TIMESTAMP,timestamp,null], [DATETIME,timestamp,null], [BINARY,binary,null], [ARRAY,array<int>,null], [MAP,map<string,string>,null], [STRUCT,struct<field1:string,field2:int>,null], [VARCHAR,string,null], [CHAR,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`alltypes`, false, [col_name#4163, data_type#4164, comment#4165]

== Physical Plan ==
CommandResult [col_name#4163, data_type#4164, comment#4165]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`alltypes`, false, [col_name#4163, data_type#4164, comment#4165]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5592, data_type#5593, comment#5594]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5592, data_type#5593, comment#5594]

== Optimized Logical Plan ==
CommandResult [col_name#5592, data_type#5593, comment#5594], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5592, data_type#5593, comment#5594]

== Physical Plan ==
CommandResult [col_name#5592, data_type#5593, comment#5594]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5592, data_type#5593, comment#5594]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5615, data_type#5616, comment#5617]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5615, data_type#5616, comment#5617]

== Optimized Logical Plan ==
CommandResult [col_name#5615, data_type#5616, comment#5617], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5615, data_type#5616, comment#5617]

== Physical Plan ==
CommandResult [col_name#5615, data_type#5616, comment#5617]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5615, data_type#5616, comment#5617]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#5567, value#5568, meaning#5569, Since version#5570], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#5567, value#5568, meaning#5569, Since version#5570]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5183, data_type#5184, comment#5185]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5183, data_type#5184, comment#5185]

== Optimized Logical Plan ==
CommandResult [col_name#5183, data_type#5184, comment#5185], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5183, data_type#5184, comment#5185]

== Physical Plan ==
CommandResult [col_name#5183, data_type#5184, comment#5185]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5183, data_type#5184, comment#5185]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#5135, value#5136, meaning#5137, Since version#5138], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#5135, value#5136, meaning#5137, Since version#5138]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#3284, data_type#3285, comment#3286]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3284, data_type#3285, comment#3286]

== Optimized Logical Plan ==
CommandResult [col_name#3284, data_type#3285, comment#3286], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3284, data_type#3285, comment#3286]

== Physical Plan ==
CommandResult [col_name#3284, data_type#3285, comment#3286]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3284, data_type#3285, comment#3286]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4242, data_type#4243, comment#4244]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4242, data_type#4243, comment#4244]

== Optimized Logical Plan ==
CommandResult [col_name#4242, data_type#4243, comment#4244], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4242, data_type#4243, comment#4244]

== Physical Plan ==
CommandResult [col_name#4242, data_type#4243, comment#4244]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4242, data_type#4243, comment#4244]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4607, data_type#4608, comment#4609]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4607, data_type#4608, comment#4609]

== Optimized Logical Plan ==
CommandResult [col_name#4607, data_type#4608, comment#4609], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4607, data_type#4608, comment#4609]

== Physical Plan ==
CommandResult [col_name#4607, data_type#4608, comment#4609]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4607, data_type#4608, comment#4609]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4751, data_type#4752, comment#4753]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4751, data_type#4752, comment#4753]

== Optimized Logical Plan ==
CommandResult [col_name#4751, data_type#4752, comment#4753], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4751, data_type#4752, comment#4753]

== Physical Plan ==
CommandResult [col_name#4751, data_type#4752, comment#4753]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4751, data_type#4752, comment#4753]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4703, value#4704, meaning#4705, Since version#4706], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4703, value#4704, meaning#4705, Since version#4706]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#5279, value#5280, meaning#5281, Since version#5282], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#5279, value#5280, meaning#5281, Since version#5282]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5327, data_type#5328, comment#5329]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5327, data_type#5328, comment#5329]

== Optimized Logical Plan ==
CommandResult [col_name#5327, data_type#5328, comment#5329], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5327, data_type#5328, comment#5329]

== Physical Plan ==
CommandResult [col_name#5327, data_type#5328, comment#5329]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5327, data_type#5328, comment#5329]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4991, value#4992, meaning#4993, Since version#4994], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4991, value#4992, meaning#4993, Since version#4994]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4265, data_type#4266, comment#4267]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4265, data_type#4266, comment#4267]

== Optimized Logical Plan ==
CommandResult [col_name#4265, data_type#4266, comment#4267], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4265, data_type#4266, comment#4267]

== Physical Plan ==
CommandResult [col_name#4265, data_type#4266, comment#4267]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4265, data_type#4266, comment#4267]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5160, data_type#5161, comment#5162]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5160, data_type#5161, comment#5162]

== Optimized Logical Plan ==
CommandResult [col_name#5160, data_type#5161, comment#5162], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5160, data_type#5161, comment#5162]

== Physical Plan ==
CommandResult [col_name#5160, data_type#5161, comment#5162]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5160, data_type#5161, comment#5162]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#3261, data_type#3262, comment#3263]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3261, data_type#3262, comment#3263]

== Optimized Logical Plan ==
CommandResult [col_name#3261, data_type#3262, comment#3263], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3261, data_type#3262, comment#3263]

== Physical Plan ==
CommandResult [col_name#3261, data_type#3262, comment#3263]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3261, data_type#3262, comment#3263]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#2573, value#2574, meaning#2575, Since version#2576], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#2573, value#2574, meaning#2575, Since version#2576]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#2033, value#2034, meaning#2035, Since version#2036], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#2033, value#2034, meaning#2035, Since version#2036]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#2429, value#2430, meaning#2431, Since version#2432], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#2429, value#2430, meaning#2431, Since version#2432]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2621, data_type#2622, comment#2623]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2621, data_type#2622, comment#2623]

== Optimized Logical Plan ==
CommandResult [col_name#2621, data_type#2622, comment#2623], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2621, data_type#2622, comment#2623]

== Physical Plan ==
CommandResult [col_name#2621, data_type#2622, comment#2623]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2621, data_type#2622, comment#2623]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#3236, value#3237, meaning#3238, Since version#3239], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#3236, value#3237, meaning#3238, Since version#3239]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5016, data_type#5017, comment#5018]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5016, data_type#5017, comment#5018]

== Optimized Logical Plan ==
CommandResult [col_name#5016, data_type#5017, comment#5018], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5016, data_type#5017, comment#5018]

== Physical Plan ==
CommandResult [col_name#5016, data_type#5017, comment#5018]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5016, data_type#5017, comment#5018]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5304, data_type#5305, comment#5306]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5304, data_type#5305, comment#5306]

== Optimized Logical Plan ==
CommandResult [col_name#5304, data_type#5305, comment#5306], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5304, data_type#5305, comment#5306]

== Physical Plan ==
CommandResult [col_name#5304, data_type#5305, comment#5306]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5304, data_type#5305, comment#5306]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5039, data_type#5040, comment#5041]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5039, data_type#5040, comment#5041]

== Optimized Logical Plan ==
CommandResult [col_name#5039, data_type#5040, comment#5041], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5039, data_type#5040, comment#5041]

== Physical Plan ==
CommandResult [col_name#5039, data_type#5040, comment#5041]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5039, data_type#5040, comment#5041]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2454, data_type#2455, comment#2456]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2454, data_type#2455, comment#2456]

== Optimized Logical Plan ==
CommandResult [col_name#2454, data_type#2455, comment#2456], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2454, data_type#2455, comment#2456]

== Physical Plan ==
CommandResult [col_name#2454, data_type#2455, comment#2456]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2454, data_type#2455, comment#2456]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#3856, data_type#3857, comment#3858]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3856, data_type#3857, comment#3858]

== Optimized Logical Plan ==
CommandResult [col_name#3856, data_type#3857, comment#3858], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3856, data_type#3857, comment#3858]

== Physical Plan ==
CommandResult [col_name#3856, data_type#3857, comment#3858]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3856, data_type#3857, comment#3858]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2058, data_type#2059, comment#2060]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2058, data_type#2059, comment#2060]

== Optimized Logical Plan ==
CommandResult [col_name#2058, data_type#2059, comment#2060], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2058, data_type#2059, comment#2060]

== Physical Plan ==
CommandResult [col_name#2058, data_type#2059, comment#2060]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2058, data_type#2059, comment#2060]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4728, data_type#4729, comment#4730]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4728, data_type#4729, comment#4730]

== Optimized Logical Plan ==
CommandResult [col_name#4728, data_type#4729, comment#4730], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4728, data_type#4729, comment#4730]

== Physical Plan ==
CommandResult [col_name#4728, data_type#4729, comment#4730]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4728, data_type#4729, comment#4730]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#3833, data_type#3834, comment#3835]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3833, data_type#3834, comment#3835]

== Optimized Logical Plan ==
CommandResult [col_name#3833, data_type#3834, comment#3835], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3833, data_type#3834, comment#3835]

== Physical Plan ==
CommandResult [col_name#3833, data_type#3834, comment#3835]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#3833, data_type#3834, comment#3835]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4584, data_type#4585, comment#4586]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4584, data_type#4585, comment#4586]

== Optimized Logical Plan ==
CommandResult [col_name#4584, data_type#4585, comment#4586], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4584, data_type#4585, comment#4586]

== Physical Plan ==
CommandResult [col_name#4584, data_type#4585, comment#4586]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4584, data_type#4585, comment#4586]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2081, data_type#2082, comment#2083]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2081, data_type#2082, comment#2083]

== Optimized Logical Plan ==
CommandResult [col_name#2081, data_type#2082, comment#2083], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2081, data_type#2082, comment#2083]

== Physical Plan ==
CommandResult [col_name#2081, data_type#2082, comment#2083]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2081, data_type#2082, comment#2083]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2598, data_type#2599, comment#2600]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2598, data_type#2599, comment#2600]

== Optimized Logical Plan ==
CommandResult [col_name#2598, data_type#2599, comment#2600], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2598, data_type#2599, comment#2600]

== Physical Plan ==
CommandResult [col_name#2598, data_type#2599, comment#2600]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2598, data_type#2599, comment#2600]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4559, value#4560, meaning#4561, Since version#4562], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4559, value#4560, meaning#4561, Since version#4562]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2477, data_type#2478, comment#2479]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2477, data_type#2478, comment#2479]

== Optimized Logical Plan ==
CommandResult [col_name#2477, data_type#2478, comment#2479], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2477, data_type#2478, comment#2479]

== Physical Plan ==
CommandResult [col_name#2477, data_type#2478, comment#2479]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2477, data_type#2478, comment#2479]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2822, data_type#2823, comment#2824]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2822, data_type#2823, comment#2824]

== Optimized Logical Plan ==
CommandResult [col_name#2822, data_type#2823, comment#2824], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2822, data_type#2823, comment#2824]

== Physical Plan ==
CommandResult [col_name#2822, data_type#2823, comment#2824]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2822, data_type#2823, comment#2824]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#1937, data_type#1938, comment#1939]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#1937, data_type#1938, comment#1939]

== Optimized Logical Plan ==
CommandResult [col_name#1937, data_type#1938, comment#1939], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#1937, data_type#1938, comment#1939]

== Physical Plan ==
CommandResult [col_name#1937, data_type#1938, comment#1939]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#1937, data_type#1938, comment#1939]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#2797, value#2798, meaning#2799, Since version#2800], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#2797, value#2798, meaning#2799, Since version#2800]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2845, data_type#2846, comment#2847]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2845, data_type#2846, comment#2847]

== Optimized Logical Plan ==
CommandResult [col_name#2845, data_type#2846, comment#2847], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2845, data_type#2846, comment#2847]

== Physical Plan ==
CommandResult [col_name#2845, data_type#2846, comment#2847]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2845, data_type#2846, comment#2847]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5448, data_type#5449, comment#5450]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5448, data_type#5449, comment#5450]

== Optimized Logical Plan ==
CommandResult [col_name#5448, data_type#5449, comment#5450], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5448, data_type#5449, comment#5450]

== Physical Plan ==
CommandResult [col_name#5448, data_type#5449, comment#5450]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5448, data_type#5449, comment#5450]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4872, data_type#4873, comment#4874]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4872, data_type#4873, comment#4874]

== Optimized Logical Plan ==
CommandResult [col_name#4872, data_type#4873, comment#4874], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4872, data_type#4873, comment#4874]

== Physical Plan ==
CommandResult [col_name#4872, data_type#4873, comment#4874]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4872, data_type#4873, comment#4874]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4895, data_type#4896, comment#4897]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4895, data_type#4896, comment#4897]

== Optimized Logical Plan ==
CommandResult [col_name#4895, data_type#4896, comment#4897], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4895, data_type#4896, comment#4897]

== Physical Plan ==
CommandResult [col_name#4895, data_type#4896, comment#4897]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4895, data_type#4896, comment#4897]

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4217, value#4218, meaning#4219, Since version#4220], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4217, value#4218, meaning#4219, Since version#4220]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#5471, data_type#5472, comment#5473]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5471, data_type#5472, comment#5473]

== Optimized Logical Plan ==
CommandResult [col_name#5471, data_type#5472, comment#5473], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5471, data_type#5472, comment#5473]

== Physical Plan ==
CommandResult [col_name#5471, data_type#5472, comment#5473]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#5471, data_type#5472, comment#5473]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4463, data_type#4464, comment#4465]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4463, data_type#4464, comment#4465]

== Optimized Logical Plan ==
CommandResult [col_name#4463, data_type#4464, comment#4465], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4463, data_type#4464, comment#4465]

== Physical Plan ==
CommandResult [col_name#4463, data_type#4464, comment#4465]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4463, data_type#4464, comment#4465]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#4440, data_type#4441, comment#4442]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4440, data_type#4441, comment#4442]

== Optimized Logical Plan ==
CommandResult [col_name#4440, data_type#4441, comment#4442], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4440, data_type#4441, comment#4442]

== Physical Plan ==
CommandResult [col_name#4440, data_type#4441, comment#4442]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#4440, data_type#4441, comment#4442]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2202, data_type#2203, comment#2204]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2202, data_type#2203, comment#2204]

== Optimized Logical Plan ==
CommandResult [col_name#2202, data_type#2203, comment#2204], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2202, data_type#2203, comment#2204]

== Physical Plan ==
CommandResult [col_name#2202, data_type#2203, comment#2204]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2202, data_type#2203, comment#2204]

== Parsed Logical Plan ==
'DescribeRelation false, [col_name#2225, data_type#2226, comment#2227]
+- 'UnresolvedTableOrView [default, airports], DESCRIBE TABLE, true

== Analyzed Logical Plan ==
col_name: string, data_type: string, comment: string
DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2225, data_type#2226, comment#2227]

== Optimized Logical Plan ==
CommandResult [col_name#2225, data_type#2226, comment#2227], Execute DescribeTableCommand, [[id,string,null], [type,string,null], [name,string,null], [lat,double,null], [lon,double,null], [elev,double,null], [continent,string,null], [country,string,null], [region,string,null], [city,string,null], [iata,string,null], [code,string,null], [gps,string,null]]
   +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2225, data_type#2226, comment#2227]

== Physical Plan ==
CommandResult [col_name#2225, data_type#2226, comment#2227]
   +- Execute DescribeTableCommand
         +- DescribeTableCommand `spark_catalog`.`default`.`airports`, false, [col_name#2225, data_type#2226, comment#2227]

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_23 DESC NULLS LAST], true
      +- 'Project ['C_0 AS C_12#5654, 'C_1 AS C_17#5655, 'C_2 AS C_14#5656, 'C_4331 AS C_25#5657, 'C_4332 AS C_18#5658, 'C_4333 AS C_21#5659, 'C_4 AS C_22#5660, 'C_6 AS C_19#5661, 'C_8 AS C_13#5662, 'C_9 AS C_20#5663, 'C_10 AS C_24#5664, 'C_43 AS C_16#5665, 'C_11 AS C_15#5666, 'C_7 AS C_23#5667]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_0#5638, 'C_64656661756c745f616972706f727473.type AS C_1#5639, 'C_64656661756c745f616972706f727473.name AS C_2#5640, 'C_64656661756c745f616972706f727473.lat AS C_5#5641, 'C_64656661756c745f616972706f727473.lon AS C_3#5642, 'C_64656661756c745f616972706f727473.elev AS C_7#5643, 'C_64656661756c745f616972706f727473.continent AS C_4#5644, 'C_64656661756c745f616972706f727473.country AS C_6#5645, 'C_64656661756c745f616972706f727473.region AS C_8#5646, 'C_64656661756c745f616972706f727473.city AS C_9#5647, 'C_64656661756c745f616972706f727473.iata AS C_10#5648, 'C_64656661756c745f616972706f727473.code AS C_43#5649, 'C_64656661756c745f616972706f727473.gps AS C_11#5650, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#5651, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#5652, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#5653]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_12: string, C_17: string, C_14: string, C_25: double, C_18: double, C_21: double, C_22: string, C_19: string, C_13: string, C_20: string, C_24: string, C_16: string, C_15: string, C_23: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_23#5667 DESC NULLS LAST], true
      +- Project [C_0#5638 AS C_12#5654, C_1#5639 AS C_17#5655, C_2#5640 AS C_14#5656, C_4331#5651 AS C_25#5657, C_4332#5652 AS C_18#5658, C_4333#5653 AS C_21#5659, C_4#5644 AS C_22#5660, C_6#5645 AS C_19#5661, C_8#5646 AS C_13#5662, C_9#5647 AS C_20#5663, C_10#5648 AS C_24#5664, C_43#5649 AS C_16#5665, C_11#5650 AS C_15#5666, C_7#5643 AS C_23#5667]
         +- SubqueryAlias C_4954424c
            +- Project [id#5668 AS C_0#5638, type#5669 AS C_1#5639, name#5670 AS C_2#5640, lat#5671 AS C_5#5641, lon#5672 AS C_3#5642, elev#5673 AS C_7#5643, continent#5674 AS C_4#5644, country#5675 AS C_6#5645, region#5676 AS C_8#5646, city#5677 AS C_9#5647, iata#5678 AS C_10#5648, code#5679 AS C_43#5649, gps#5680 AS C_11#5650, (round((lat#5671 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#5651, (round((lon#5672 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#5652, (round((elev#5673 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#5653]
               +- Filter (((lon#5672 <= -104.05) AND (lon#5672 >= -111.05)) AND ((lat#5671 >= 41.0) AND (lat#5671 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#5668,type#5669,name#5670,lat#5671,lon#5672,elev#5673,continent#5674,country#5675,region#5676,city#5677,iata#5678,code#5679,gps#5680] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_23#5667 DESC NULLS LAST], true
      +- Project [id#5668 AS C_12#5654, type#5669 AS C_17#5655, name#5670 AS C_14#5656, (round((lat#5671 * 1000.0), 0) / 1000.0) AS C_25#5657, (round((lon#5672 * 1000.0), 0) / 1000.0) AS C_18#5658, (round((elev#5673 * 1000.0), 0) / 1000.0) AS C_21#5659, continent#5674 AS C_22#5660, country#5675 AS C_19#5661, region#5676 AS C_13#5662, city#5677 AS C_20#5663, iata#5678 AS C_24#5664, code#5679 AS C_16#5665, gps#5680 AS C_15#5666, elev#5673 AS C_23#5667]
         +- Filter ((isnotnull(lon#5672) AND isnotnull(lat#5671)) AND (((lon#5672 <= -104.05) AND (lon#5672 >= -111.05)) AND ((lat#5671 >= 41.0) AND (lat#5671 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#5668,type#5669,name#5670,lat#5671,lon#5672,elev#5673,continent#5674,country#5675,region#5676,city#5677,iata#5678,code#5679,gps#5680] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_23#5667 DESC NULLS LAST], output=[C_12#5654,C_17#5655,C_14#5656,C_25#5657,C_18#5658,C_21#5659,C_22#5660,C_19#5661,C_13#5662,C_20#5663,C_24#5664,C_16#5665,C_15#5666,C_23#5667])
+- *(1) Project [id#5668 AS C_12#5654, type#5669 AS C_17#5655, name#5670 AS C_14#5656, (round((lat#5671 * 1000.0), 0) / 1000.0) AS C_25#5657, (round((lon#5672 * 1000.0), 0) / 1000.0) AS C_18#5658, (round((elev#5673 * 1000.0), 0) / 1000.0) AS C_21#5659, continent#5674 AS C_22#5660, country#5675 AS C_19#5661, region#5676 AS C_13#5662, city#5677 AS C_20#5663, iata#5678 AS C_24#5664, code#5679 AS C_16#5665, gps#5680 AS C_15#5666, elev#5673 AS C_23#5667]
   +- *(1) Filter (((((isnotnull(lon#5672) AND isnotnull(lat#5671)) AND (lon#5672 <= -104.05)) AND (lon#5672 >= -111.05)) AND (lat#5671 >= 41.0)) AND (lat#5671 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#5668,type#5669,name#5670,lat#5671,lon#5672,elev#5673,continent#5674,country#5675,region#5676,city#5677,iata#5678,code#5679,gps#5680] Batched: true, DataFilters: [isnotnull(lon#5672), isnotnull(lat#5671), (lon#5672 <= -104.05), (lon#5672 >= -111.05), (lat#567..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#5423, value#5424, meaning#5425, Since version#5426], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#5423, value#5424, meaning#5425, Since version#5426]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_24 DESC NULLS LAST], true
      +- 'Project ['C_5 AS C_13#4790, 'C_43 AS C_23#4791, 'C_6 AS C_15#4792, 'C_4331 AS C_19#4793, 'C_4332 AS C_21#4794, 'C_4333 AS C_18#4795, 'C_0 AS C_25#4796, 'C_1 AS C_20#4797, 'C_2 AS C_16#4798, 'C_3 AS C_22#4799, 'C_4 AS C_12#4800, 'C_10 AS C_17#4801, 'C_11 AS C_14#4802, 'C_9 AS C_24#4803]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_5#4774, 'C_64656661756c745f616972706f727473.type AS C_43#4775, 'C_64656661756c745f616972706f727473.name AS C_6#4776, 'C_64656661756c745f616972706f727473.lat AS C_7#4777, 'C_64656661756c745f616972706f727473.lon AS C_8#4778, 'C_64656661756c745f616972706f727473.elev AS C_9#4779, 'C_64656661756c745f616972706f727473.continent AS C_0#4780, 'C_64656661756c745f616972706f727473.country AS C_1#4781, 'C_64656661756c745f616972706f727473.region AS C_2#4782, 'C_64656661756c745f616972706f727473.city AS C_3#4783, 'C_64656661756c745f616972706f727473.iata AS C_4#4784, 'C_64656661756c745f616972706f727473.code AS C_10#4785, 'C_64656661756c745f616972706f727473.gps AS C_11#4786, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#4787, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#4788, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#4789]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_13: string, C_23: string, C_15: string, C_19: double, C_21: double, C_18: double, C_25: string, C_20: string, C_16: string, C_22: string, C_12: string, C_17: string, C_14: string, C_24: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_24#4803 DESC NULLS LAST], true
      +- Project [C_5#4774 AS C_13#4790, C_43#4775 AS C_23#4791, C_6#4776 AS C_15#4792, C_4331#4787 AS C_19#4793, C_4332#4788 AS C_21#4794, C_4333#4789 AS C_18#4795, C_0#4780 AS C_25#4796, C_1#4781 AS C_20#4797, C_2#4782 AS C_16#4798, C_3#4783 AS C_22#4799, C_4#4784 AS C_12#4800, C_10#4785 AS C_17#4801, C_11#4786 AS C_14#4802, C_9#4779 AS C_24#4803]
         +- SubqueryAlias C_4954424c
            +- Project [id#4804 AS C_5#4774, type#4805 AS C_43#4775, name#4806 AS C_6#4776, lat#4807 AS C_7#4777, lon#4808 AS C_8#4778, elev#4809 AS C_9#4779, continent#4810 AS C_0#4780, country#4811 AS C_1#4781, region#4812 AS C_2#4782, city#4813 AS C_3#4783, iata#4814 AS C_4#4784, code#4815 AS C_10#4785, gps#4816 AS C_11#4786, (round((lat#4807 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#4787, (round((lon#4808 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#4788, (round((elev#4809 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#4789]
               +- Filter (((lon#4808 <= -104.05) AND (lon#4808 >= -111.05)) AND ((lat#4807 >= 41.0) AND (lat#4807 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#4804,type#4805,name#4806,lat#4807,lon#4808,elev#4809,continent#4810,country#4811,region#4812,city#4813,iata#4814,code#4815,gps#4816] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_24#4803 DESC NULLS LAST], true
      +- Project [id#4804 AS C_13#4790, type#4805 AS C_23#4791, name#4806 AS C_15#4792, (round((lat#4807 * 1000.0), 0) / 1000.0) AS C_19#4793, (round((lon#4808 * 1000.0), 0) / 1000.0) AS C_21#4794, (round((elev#4809 * 1000.0), 0) / 1000.0) AS C_18#4795, continent#4810 AS C_25#4796, country#4811 AS C_20#4797, region#4812 AS C_16#4798, city#4813 AS C_22#4799, iata#4814 AS C_12#4800, code#4815 AS C_17#4801, gps#4816 AS C_14#4802, elev#4809 AS C_24#4803]
         +- Filter ((isnotnull(lon#4808) AND isnotnull(lat#4807)) AND (((lon#4808 <= -104.05) AND (lon#4808 >= -111.05)) AND ((lat#4807 >= 41.0) AND (lat#4807 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#4804,type#4805,name#4806,lat#4807,lon#4808,elev#4809,continent#4810,country#4811,region#4812,city#4813,iata#4814,code#4815,gps#4816] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_24#4803 DESC NULLS LAST], output=[C_13#4790,C_23#4791,C_15#4792,C_19#4793,C_21#4794,C_18#4795,C_25#4796,C_20#4797,C_16#4798,C_22#4799,C_12#4800,C_17#4801,C_14#4802,C_24#4803])
+- *(1) Project [id#4804 AS C_13#4790, type#4805 AS C_23#4791, name#4806 AS C_15#4792, (round((lat#4807 * 1000.0), 0) / 1000.0) AS C_19#4793, (round((lon#4808 * 1000.0), 0) / 1000.0) AS C_21#4794, (round((elev#4809 * 1000.0), 0) / 1000.0) AS C_18#4795, continent#4810 AS C_25#4796, country#4811 AS C_20#4797, region#4812 AS C_16#4798, city#4813 AS C_22#4799, iata#4814 AS C_12#4800, code#4815 AS C_17#4801, gps#4816 AS C_14#4802, elev#4809 AS C_24#4803]
   +- *(1) Filter (((((isnotnull(lon#4808) AND isnotnull(lat#4807)) AND (lon#4808 <= -104.05)) AND (lon#4808 >= -111.05)) AND (lat#4807 >= 41.0)) AND (lat#4807 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#4804,type#4805,name#4806,lat#4807,lon#4808,elev#4809,continent#4810,country#4811,region#4812,city#4813,iata#4814,code#4815,gps#4816] Batched: true, DataFilters: [isnotnull(lon#4808), isnotnull(lat#4807), (lon#4808 <= -104.05), (lon#4808 >= -111.05), (lat#480..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4415, value#4416, meaning#4417, Since version#4418], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4415, value#4416, meaning#4417, Since version#4418]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#2177, value#2178, meaning#2179, Since version#2180], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#2177, value#2178, meaning#2179, Since version#2180]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
SetCommand (-v,None)

== Analyzed Logical Plan ==
key: string, value: string, meaning: string, Since version: string
SetCommand (-v,None)

== Optimized Logical Plan ==
CommandResult [key#4847, value#4848, meaning#4849, Since version#4850], Execute SetCommand, [[spark.sql.adaptive.advisoryPartitionSizeInBytes,<value of spark.sql.adaptive.shuffle.targetPostShuffleInputSize>,The advisory size in bytes of the shuffle partition during adaptive optimization (when spark.sql.adaptive.enabled is true). It takes effect when Spark coalesces small shuffle partitions or splits skewed shuffle partition.,3.0.0], [spark.sql.adaptive.autoBroadcastJoinThreshold,<undefined>,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join. By setting this value to -1 broadcasting can be disabled. The default value is same with spark.sql.autoBroadcastJoinThreshold. Note that, this config is used only in adaptive framework.,3.2.0], [spark.sql.adaptive.coalescePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will coalesce contiguous shuffle partitions according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid too many small tasks.,3.0.0], [spark.sql.adaptive.coalescePartitions.initialPartitionNum,<undefined>,The initial number of shuffle partitions before coalescing. If not set, it equals to spark.sql.shuffle.partitions. This configuration only has an effect when 'spark.sql.adaptive.enabled' and 'spark.sql.adaptive.coalescePartitions.enabled' are both true.,3.0.0], [spark.sql.adaptive.coalescePartitions.minPartitionSize,1MB,The minimum size of shuffle partitions after coalescing. This is useful when the adaptively calculated target size is too small during partition coalescing.,3.2.0], [spark.sql.adaptive.coalescePartitions.parallelismFirst,true,When true, Spark does not respect the target size specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes' (default 64MB) when coalescing contiguous shuffle partitions, but adaptively calculate the target size according to the default parallelism of the Spark cluster. The calculated size is usually smaller than the configured target size. This is to maximize the parallelism and avoid performance regression when enabling adaptive query execution. It's recommended to set this config to false and respect the configured target size.,3.2.0], [spark.sql.adaptive.customCostEvaluatorClass,<undefined>,The custom cost evaluator class to be used for adaptive execution. If not being set, Spark will use its own SimpleCostEvaluator by default.,3.2.0], [spark.sql.adaptive.enabled,true,When true, enable adaptive query execution, which re-optimizes the query plan in the middle of query execution, based on accurate runtime statistics.,1.6.0], [spark.sql.adaptive.forceOptimizeSkewedJoin,false,When true, force enable OptimizeSkewedJoin even if it introduces extra shuffle.,3.3.0], [spark.sql.adaptive.localShuffleReader.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark tries to use local shuffle reader to read the shuffle data when the shuffle partitioning is not needed, for example, after converting sort-merge join to broadcast-hash join.,3.0.0], [spark.sql.adaptive.maxShuffledHashJoinLocalMapThreshold,0b,Configures the maximum size in bytes per partition that can be allowed to build local hash map. If this value is not smaller than spark.sql.adaptive.advisoryPartitionSizeInBytes and all the partition size are not larger than this config, join selection prefer to use shuffled hash join instead of sort merge join regardless of the value of spark.sql.join.preferSortMergeJoin.,3.2.0], [spark.sql.adaptive.optimizeSkewsInRebalancePartitions.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark will optimize the skewed shuffle partitions in RebalancePartitions and split them to smaller ones according to the target size (specified by 'spark.sql.adaptive.advisoryPartitionSizeInBytes'), to avoid data skew.,3.2.0], [spark.sql.adaptive.optimizer.excludedRules,<undefined>,Configures a list of rules to be disabled in the adaptive optimizer, in which the rules are specified by their rule names and separated by comma. The optimizer will log the rules that have indeed been excluded.,3.1.0], [spark.sql.adaptive.rebalancePartitionsSmallPartitionFactor,0.2,A partition will be merged during splitting if its size is small than this factor multiply spark.sql.adaptive.advisoryPartitionSizeInBytes.,3.3.0], [spark.sql.adaptive.skewJoin.enabled,true,When true and 'spark.sql.adaptive.enabled' is true, Spark dynamically handles skew in shuffled join (sort-merge and shuffled hash) by splitting (and replicating if needed) skewed partitions.,3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionFactor,5.0,A partition is considered as skewed if its size is larger than this factor multiplying the median partition size and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes',3.0.0], [spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes,256MB,A partition is considered as skewed if its size in bytes is larger than this threshold and also larger than 'spark.sql.adaptive.skewJoin.skewedPartitionFactor' multiplying the median partition size. Ideally this config should be set larger than 'spark.sql.adaptive.advisoryPartitionSizeInBytes'.,3.0.0], [spark.sql.allowNamedFunctionArguments,true,If true, Spark will turn on support for named parameters for all functions that has it implemented.,3.5.0], [spark.sql.ansi.doubleQuotedIdentifiers,false,When true and 'spark.sql.ansi.enabled' is true, Spark SQL reads literals enclosed in double quoted (") as identifiers. When false they are read as string literals.,3.4.0], [spark.sql.ansi.enabled,false,When true, Spark SQL uses an ANSI compliant dialect instead of being Hive compliant. For example, Spark will throw an exception at runtime instead of returning null results when the inputs to a SQL operator/function are invalid.For full details of this dialect, you can find them in the section "ANSI Compliance" of Spark's documentation. Some ANSI dialect features may be not from the ANSI SQL standard directly, but their behaviors align with ANSI SQL's style,3.0.0], [spark.sql.ansi.enforceReservedKeywords,false,When true and 'spark.sql.ansi.enabled' is true, the Spark SQL parser enforces the ANSI reserved keywords and forbids SQL queries that use reserved keywords as alias names and/or identifiers for table, view, function, etc.,3.3.0], [spark.sql.ansi.relationPrecedence,false,When true and 'spark.sql.ansi.enabled' is true, JOIN takes precedence over comma when combining relation. For example, `t1, t2 JOIN t3` should result to `t1 X (t2 X t3)`. If the config is false, the result is `(t1 X t2) X t3`.,3.4.0], [spark.sql.autoBroadcastJoinThreshold,10MB,Configures the maximum size in bytes for a table that will be broadcast to all worker nodes when performing a join.  By setting this value to -1 broadcasting can be disabled. Note that currently statistics are only supported for Hive Metastore tables where the command `ANALYZE TABLE <tableName> COMPUTE STATISTICS noscan` has been run, and file-based data source tables where the statistics are computed directly on the files of data.,1.1.0], [spark.sql.avro.compression.codec,snappy,Compression codec used in writing of AVRO files. Supported codecs: uncompressed, deflate, snappy, bzip2, xz and zstandard. Default codec is snappy.,2.4.0], ... 183 more fields]
   +- SetCommand (-v,None)

== Physical Plan ==
CommandResult [key#4847, value#4848, meaning#4849, Since version#4850]
   +- Execute SetCommand
         +- SetCommand (-v,None)

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_16 DESC NULLS LAST], true
      +- 'Project ['C_5 AS C_18#4646, 'C_6 AS C_19#4647, 'C_0 AS C_15#4648, 'C_4331 AS C_22#4649, 'C_4332 AS C_25#4650, 'C_4333 AS C_20#4651, 'C_4 AS C_23#4652, 'C_43 AS C_14#4653, 'C_11 AS C_12#4654, 'C_8 AS C_17#4655, 'C_7 AS C_24#4656, 'C_9 AS C_21#4657, 'C_10 AS C_13#4658, 'C_3 AS C_16#4659]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_5#4630, 'C_64656661756c745f616972706f727473.type AS C_6#4631, 'C_64656661756c745f616972706f727473.name AS C_0#4632, 'C_64656661756c745f616972706f727473.lat AS C_1#4633, 'C_64656661756c745f616972706f727473.lon AS C_2#4634, 'C_64656661756c745f616972706f727473.elev AS C_3#4635, 'C_64656661756c745f616972706f727473.continent AS C_4#4636, 'C_64656661756c745f616972706f727473.country AS C_43#4637, 'C_64656661756c745f616972706f727473.region AS C_11#4638, 'C_64656661756c745f616972706f727473.city AS C_8#4639, 'C_64656661756c745f616972706f727473.iata AS C_7#4640, 'C_64656661756c745f616972706f727473.code AS C_9#4641, 'C_64656661756c745f616972706f727473.gps AS C_10#4642, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#4643, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#4644, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#4645]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_18: string, C_19: string, C_15: string, C_22: double, C_25: double, C_20: double, C_23: string, C_14: string, C_12: string, C_17: string, C_24: string, C_21: string, C_13: string, C_16: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_16#4659 DESC NULLS LAST], true
      +- Project [C_5#4630 AS C_18#4646, C_6#4631 AS C_19#4647, C_0#4632 AS C_15#4648, C_4331#4643 AS C_22#4649, C_4332#4644 AS C_25#4650, C_4333#4645 AS C_20#4651, C_4#4636 AS C_23#4652, C_43#4637 AS C_14#4653, C_11#4638 AS C_12#4654, C_8#4639 AS C_17#4655, C_7#4640 AS C_24#4656, C_9#4641 AS C_21#4657, C_10#4642 AS C_13#4658, C_3#4635 AS C_16#4659]
         +- SubqueryAlias C_4954424c
            +- Project [id#4660 AS C_5#4630, type#4661 AS C_6#4631, name#4662 AS C_0#4632, lat#4663 AS C_1#4633, lon#4664 AS C_2#4634, elev#4665 AS C_3#4635, continent#4666 AS C_4#4636, country#4667 AS C_43#4637, region#4668 AS C_11#4638, city#4669 AS C_8#4639, iata#4670 AS C_7#4640, code#4671 AS C_9#4641, gps#4672 AS C_10#4642, (round((lat#4663 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#4643, (round((lon#4664 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#4644, (round((elev#4665 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#4645]
               +- Filter (((lon#4664 <= -104.05) AND (lon#4664 >= -111.05)) AND ((lat#4663 >= 41.0) AND (lat#4663 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#4660,type#4661,name#4662,lat#4663,lon#4664,elev#4665,continent#4666,country#4667,region#4668,city#4669,iata#4670,code#4671,gps#4672] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_16#4659 DESC NULLS LAST], true
      +- Project [id#4660 AS C_18#4646, type#4661 AS C_19#4647, name#4662 AS C_15#4648, (round((lat#4663 * 1000.0), 0) / 1000.0) AS C_22#4649, (round((lon#4664 * 1000.0), 0) / 1000.0) AS C_25#4650, (round((elev#4665 * 1000.0), 0) / 1000.0) AS C_20#4651, continent#4666 AS C_23#4652, country#4667 AS C_14#4653, region#4668 AS C_12#4654, city#4669 AS C_17#4655, iata#4670 AS C_24#4656, code#4671 AS C_21#4657, gps#4672 AS C_13#4658, elev#4665 AS C_16#4659]
         +- Filter ((isnotnull(lon#4664) AND isnotnull(lat#4663)) AND (((lon#4664 <= -104.05) AND (lon#4664 >= -111.05)) AND ((lat#4663 >= 41.0) AND (lat#4663 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#4660,type#4661,name#4662,lat#4663,lon#4664,elev#4665,continent#4666,country#4667,region#4668,city#4669,iata#4670,code#4671,gps#4672] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_16#4659 DESC NULLS LAST], output=[C_18#4646,C_19#4647,C_15#4648,C_22#4649,C_25#4650,C_20#4651,C_23#4652,C_14#4653,C_12#4654,C_17#4655,C_24#4656,C_21#4657,C_13#4658,C_16#4659])
+- *(1) Project [id#4660 AS C_18#4646, type#4661 AS C_19#4647, name#4662 AS C_15#4648, (round((lat#4663 * 1000.0), 0) / 1000.0) AS C_22#4649, (round((lon#4664 * 1000.0), 0) / 1000.0) AS C_25#4650, (round((elev#4665 * 1000.0), 0) / 1000.0) AS C_20#4651, continent#4666 AS C_23#4652, country#4667 AS C_14#4653, region#4668 AS C_12#4654, city#4669 AS C_17#4655, iata#4670 AS C_24#4656, code#4671 AS C_21#4657, gps#4672 AS C_13#4658, elev#4665 AS C_16#4659]
   +- *(1) Filter (((((isnotnull(lon#4664) AND isnotnull(lat#4663)) AND (lon#4664 <= -104.05)) AND (lon#4664 >= -111.05)) AND (lat#4663 >= 41.0)) AND (lat#4663 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#4660,type#4661,name#4662,lat#4663,lon#4664,elev#4665,continent#4666,country#4667,region#4668,city#4669,iata#4670,code#4671,gps#4672] Batched: true, DataFilters: [isnotnull(lon#4664), isnotnull(lat#4663), (lon#4664 <= -104.05), (lon#4664 >= -111.05), (lat#466..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_25 DESC NULLS LAST], true
      +- 'Project ['C_5 AS C_21#4304, 'C_6 AS C_18#4305, 'C_7 AS C_22#4306, 'C_4331 AS C_14#4307, 'C_4332 AS C_23#4308, 'C_4333 AS C_17#4309, 'C_0 AS C_20#4310, 'C_1 AS C_13#4311, 'C_43 AS C_12#4312, 'C_4 AS C_19#4313, 'C_2 AS C_24#4314, 'C_10 AS C_15#4315, 'C_11 AS C_16#4316, 'C_9 AS C_25#4317]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_5#4288, 'C_64656661756c745f616972706f727473.type AS C_6#4289, 'C_64656661756c745f616972706f727473.name AS C_7#4290, 'C_64656661756c745f616972706f727473.lat AS C_8#4291, 'C_64656661756c745f616972706f727473.lon AS C_3#4292, 'C_64656661756c745f616972706f727473.elev AS C_9#4293, 'C_64656661756c745f616972706f727473.continent AS C_0#4294, 'C_64656661756c745f616972706f727473.country AS C_1#4295, 'C_64656661756c745f616972706f727473.region AS C_43#4296, 'C_64656661756c745f616972706f727473.city AS C_4#4297, 'C_64656661756c745f616972706f727473.iata AS C_2#4298, 'C_64656661756c745f616972706f727473.code AS C_10#4299, 'C_64656661756c745f616972706f727473.gps AS C_11#4300, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#4301, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#4302, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#4303]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_21: string, C_18: string, C_22: string, C_14: double, C_23: double, C_17: double, C_20: string, C_13: string, C_12: string, C_19: string, C_24: string, C_15: string, C_16: string, C_25: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_25#4317 DESC NULLS LAST], true
      +- Project [C_5#4288 AS C_21#4304, C_6#4289 AS C_18#4305, C_7#4290 AS C_22#4306, C_4331#4301 AS C_14#4307, C_4332#4302 AS C_23#4308, C_4333#4303 AS C_17#4309, C_0#4294 AS C_20#4310, C_1#4295 AS C_13#4311, C_43#4296 AS C_12#4312, C_4#4297 AS C_19#4313, C_2#4298 AS C_24#4314, C_10#4299 AS C_15#4315, C_11#4300 AS C_16#4316, C_9#4293 AS C_25#4317]
         +- SubqueryAlias C_4954424c
            +- Project [id#4318 AS C_5#4288, type#4319 AS C_6#4289, name#4320 AS C_7#4290, lat#4321 AS C_8#4291, lon#4322 AS C_3#4292, elev#4323 AS C_9#4293, continent#4324 AS C_0#4294, country#4325 AS C_1#4295, region#4326 AS C_43#4296, city#4327 AS C_4#4297, iata#4328 AS C_2#4298, code#4329 AS C_10#4299, gps#4330 AS C_11#4300, (round((lat#4321 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#4301, (round((lon#4322 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#4302, (round((elev#4323 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#4303]
               +- Filter (((lon#4322 <= -104.05) AND (lon#4322 >= -111.05)) AND ((lat#4321 >= 41.0) AND (lat#4321 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#4318,type#4319,name#4320,lat#4321,lon#4322,elev#4323,continent#4324,country#4325,region#4326,city#4327,iata#4328,code#4329,gps#4330] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_25#4317 DESC NULLS LAST], true
      +- Project [id#4318 AS C_21#4304, type#4319 AS C_18#4305, name#4320 AS C_22#4306, (round((lat#4321 * 1000.0), 0) / 1000.0) AS C_14#4307, (round((lon#4322 * 1000.0), 0) / 1000.0) AS C_23#4308, (round((elev#4323 * 1000.0), 0) / 1000.0) AS C_17#4309, continent#4324 AS C_20#4310, country#4325 AS C_13#4311, region#4326 AS C_12#4312, city#4327 AS C_19#4313, iata#4328 AS C_24#4314, code#4329 AS C_15#4315, gps#4330 AS C_16#4316, elev#4323 AS C_25#4317]
         +- Filter ((isnotnull(lon#4322) AND isnotnull(lat#4321)) AND (((lon#4322 <= -104.05) AND (lon#4322 >= -111.05)) AND ((lat#4321 >= 41.0) AND (lat#4321 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#4318,type#4319,name#4320,lat#4321,lon#4322,elev#4323,continent#4324,country#4325,region#4326,city#4327,iata#4328,code#4329,gps#4330] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_25#4317 DESC NULLS LAST], output=[C_21#4304,C_18#4305,C_22#4306,C_14#4307,C_23#4308,C_17#4309,C_20#4310,C_13#4311,C_12#4312,C_19#4313,C_24#4314,C_15#4315,C_16#4316,C_25#4317])
+- *(1) Project [id#4318 AS C_21#4304, type#4319 AS C_18#4305, name#4320 AS C_22#4306, (round((lat#4321 * 1000.0), 0) / 1000.0) AS C_14#4307, (round((lon#4322 * 1000.0), 0) / 1000.0) AS C_23#4308, (round((elev#4323 * 1000.0), 0) / 1000.0) AS C_17#4309, continent#4324 AS C_20#4310, country#4325 AS C_13#4311, region#4326 AS C_12#4312, city#4327 AS C_19#4313, iata#4328 AS C_24#4314, code#4329 AS C_15#4315, gps#4330 AS C_16#4316, elev#4323 AS C_25#4317]
   +- *(1) Filter (((((isnotnull(lon#4322) AND isnotnull(lat#4321)) AND (lon#4322 <= -104.05)) AND (lon#4322 >= -111.05)) AND (lat#4321 >= 41.0)) AND (lat#4321 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#4318,type#4319,name#4320,lat#4321,lon#4322,elev#4323,continent#4324,country#4325,region#4326,city#4327,iata#4328,code#4329,gps#4330] Batched: true, DataFilters: [isnotnull(lon#4322), isnotnull(lat#4321), (lon#4322 <= -104.05), (lon#4322 >= -111.05), (lat#432..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_14 DESC NULLS LAST], true
      +- 'Project ['C_43 AS C_16#2660, 'C_3 AS C_17#2661, 'C_2 AS C_15#2662, 'C_4331 AS C_21#2663, 'C_4332 AS C_22#2664, 'C_4333 AS C_19#2665, 'C_7 AS C_18#2666, 'C_6 AS C_20#2667, 'C_9 AS C_23#2668, 'C_8 AS C_25#2669, 'C_5 AS C_24#2670, 'C_11 AS C_13#2671, 'C_10 AS C_12#2672, 'C_1 AS C_14#2673]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_43#2644, 'C_64656661756c745f616972706f727473.type AS C_3#2645, 'C_64656661756c745f616972706f727473.name AS C_2#2646, 'C_64656661756c745f616972706f727473.lat AS C_0#2647, 'C_64656661756c745f616972706f727473.lon AS C_4#2648, 'C_64656661756c745f616972706f727473.elev AS C_1#2649, 'C_64656661756c745f616972706f727473.continent AS C_7#2650, 'C_64656661756c745f616972706f727473.country AS C_6#2651, 'C_64656661756c745f616972706f727473.region AS C_9#2652, 'C_64656661756c745f616972706f727473.city AS C_8#2653, 'C_64656661756c745f616972706f727473.iata AS C_5#2654, 'C_64656661756c745f616972706f727473.code AS C_11#2655, 'C_64656661756c745f616972706f727473.gps AS C_10#2656, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#2657, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#2658, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#2659]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_16: string, C_17: string, C_15: string, C_21: double, C_22: double, C_19: double, C_18: string, C_20: string, C_23: string, C_25: string, C_24: string, C_13: string, C_12: string, C_14: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_14#2673 DESC NULLS LAST], true
      +- Project [C_43#2644 AS C_16#2660, C_3#2645 AS C_17#2661, C_2#2646 AS C_15#2662, C_4331#2657 AS C_21#2663, C_4332#2658 AS C_22#2664, C_4333#2659 AS C_19#2665, C_7#2650 AS C_18#2666, C_6#2651 AS C_20#2667, C_9#2652 AS C_23#2668, C_8#2653 AS C_25#2669, C_5#2654 AS C_24#2670, C_11#2655 AS C_13#2671, C_10#2656 AS C_12#2672, C_1#2649 AS C_14#2673]
         +- SubqueryAlias C_4954424c
            +- Project [id#2674 AS C_43#2644, type#2675 AS C_3#2645, name#2676 AS C_2#2646, lat#2677 AS C_0#2647, lon#2678 AS C_4#2648, elev#2679 AS C_1#2649, continent#2680 AS C_7#2650, country#2681 AS C_6#2651, region#2682 AS C_9#2652, city#2683 AS C_8#2653, iata#2684 AS C_5#2654, code#2685 AS C_11#2655, gps#2686 AS C_10#2656, (round((lat#2677 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#2657, (round((lon#2678 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#2658, (round((elev#2679 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#2659]
               +- Filter (((lon#2678 <= -104.05) AND (lon#2678 >= -111.05)) AND ((lat#2677 >= 41.0) AND (lat#2677 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#2674,type#2675,name#2676,lat#2677,lon#2678,elev#2679,continent#2680,country#2681,region#2682,city#2683,iata#2684,code#2685,gps#2686] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_14#2673 DESC NULLS LAST], true
      +- Project [id#2674 AS C_16#2660, type#2675 AS C_17#2661, name#2676 AS C_15#2662, (round((lat#2677 * 1000.0), 0) / 1000.0) AS C_21#2663, (round((lon#2678 * 1000.0), 0) / 1000.0) AS C_22#2664, (round((elev#2679 * 1000.0), 0) / 1000.0) AS C_19#2665, continent#2680 AS C_18#2666, country#2681 AS C_20#2667, region#2682 AS C_23#2668, city#2683 AS C_25#2669, iata#2684 AS C_24#2670, code#2685 AS C_13#2671, gps#2686 AS C_12#2672, elev#2679 AS C_14#2673]
         +- Filter ((isnotnull(lon#2678) AND isnotnull(lat#2677)) AND (((lon#2678 <= -104.05) AND (lon#2678 >= -111.05)) AND ((lat#2677 >= 41.0) AND (lat#2677 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#2674,type#2675,name#2676,lat#2677,lon#2678,elev#2679,continent#2680,country#2681,region#2682,city#2683,iata#2684,code#2685,gps#2686] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_14#2673 DESC NULLS LAST], output=[C_16#2660,C_17#2661,C_15#2662,C_21#2663,C_22#2664,C_19#2665,C_18#2666,C_20#2667,C_23#2668,C_25#2669,C_24#2670,C_13#2671,C_12#2672,C_14#2673])
+- *(1) Project [id#2674 AS C_16#2660, type#2675 AS C_17#2661, name#2676 AS C_15#2662, (round((lat#2677 * 1000.0), 0) / 1000.0) AS C_21#2663, (round((lon#2678 * 1000.0), 0) / 1000.0) AS C_22#2664, (round((elev#2679 * 1000.0), 0) / 1000.0) AS C_19#2665, continent#2680 AS C_18#2666, country#2681 AS C_20#2667, region#2682 AS C_23#2668, city#2683 AS C_25#2669, iata#2684 AS C_24#2670, code#2685 AS C_13#2671, gps#2686 AS C_12#2672, elev#2679 AS C_14#2673]
   +- *(1) Filter (((((isnotnull(lon#2678) AND isnotnull(lat#2677)) AND (lon#2678 <= -104.05)) AND (lon#2678 >= -111.05)) AND (lat#2677 >= 41.0)) AND (lat#2677 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#2674,type#2675,name#2676,lat#2677,lon#2678,elev#2679,continent#2680,country#2681,region#2682,city#2683,iata#2684,code#2685,gps#2686] Batched: true, DataFilters: [isnotnull(lon#2678), isnotnull(lat#2677), (lon#2678 <= -104.05), (lon#2678 >= -111.05), (lat#267..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_22 DESC NULLS LAST], true
      +- 'Project ['C_0 AS C_13#3323, 'C_43 AS C_14#3324, 'C_5 AS C_15#3325, 'C_4331 AS C_16#3326, 'C_4332 AS C_12#3327, 'C_4333 AS C_17#3328, 'C_1 AS C_18#3329, 'C_6 AS C_21#3330, 'C_7 AS C_19#3331, 'C_8 AS C_20#3332, 'C_10 AS C_23#3333, 'C_9 AS C_24#3334, 'C_11 AS C_25#3335, 'C_4 AS C_22#3336]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_0#3307, 'C_64656661756c745f616972706f727473.type AS C_43#3308, 'C_64656661756c745f616972706f727473.name AS C_5#3309, 'C_64656661756c745f616972706f727473.lat AS C_3#3310, 'C_64656661756c745f616972706f727473.lon AS C_2#3311, 'C_64656661756c745f616972706f727473.elev AS C_4#3312, 'C_64656661756c745f616972706f727473.continent AS C_1#3313, 'C_64656661756c745f616972706f727473.country AS C_6#3314, 'C_64656661756c745f616972706f727473.region AS C_7#3315, 'C_64656661756c745f616972706f727473.city AS C_8#3316, 'C_64656661756c745f616972706f727473.iata AS C_10#3317, 'C_64656661756c745f616972706f727473.code AS C_9#3318, 'C_64656661756c745f616972706f727473.gps AS C_11#3319, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#3320, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#3321, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#3322]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_13: string, C_14: string, C_15: string, C_16: double, C_12: double, C_17: double, C_18: string, C_21: string, C_19: string, C_20: string, C_23: string, C_24: string, C_25: string, C_22: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_22#3336 DESC NULLS LAST], true
      +- Project [C_0#3307 AS C_13#3323, C_43#3308 AS C_14#3324, C_5#3309 AS C_15#3325, C_4331#3320 AS C_16#3326, C_4332#3321 AS C_12#3327, C_4333#3322 AS C_17#3328, C_1#3313 AS C_18#3329, C_6#3314 AS C_21#3330, C_7#3315 AS C_19#3331, C_8#3316 AS C_20#3332, C_10#3317 AS C_23#3333, C_9#3318 AS C_24#3334, C_11#3319 AS C_25#3335, C_4#3312 AS C_22#3336]
         +- SubqueryAlias C_4954424c
            +- Project [id#3337 AS C_0#3307, type#3338 AS C_43#3308, name#3339 AS C_5#3309, lat#3340 AS C_3#3310, lon#3341 AS C_2#3311, elev#3342 AS C_4#3312, continent#3343 AS C_1#3313, country#3344 AS C_6#3314, region#3345 AS C_7#3315, city#3346 AS C_8#3316, iata#3347 AS C_10#3317, code#3348 AS C_9#3318, gps#3349 AS C_11#3319, (round((lat#3340 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#3320, (round((lon#3341 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#3321, (round((elev#3342 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#3322]
               +- Filter (((lon#3341 <= -104.05) AND (lon#3341 >= -111.05)) AND ((lat#3340 >= 41.0) AND (lat#3340 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#3337,type#3338,name#3339,lat#3340,lon#3341,elev#3342,continent#3343,country#3344,region#3345,city#3346,iata#3347,code#3348,gps#3349] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_22#3336 DESC NULLS LAST], true
      +- Project [id#3337 AS C_13#3323, type#3338 AS C_14#3324, name#3339 AS C_15#3325, (round((lat#3340 * 1000.0), 0) / 1000.0) AS C_16#3326, (round((lon#3341 * 1000.0), 0) / 1000.0) AS C_12#3327, (round((elev#3342 * 1000.0), 0) / 1000.0) AS C_17#3328, continent#3343 AS C_18#3329, country#3344 AS C_21#3330, region#3345 AS C_19#3331, city#3346 AS C_20#3332, iata#3347 AS C_23#3333, code#3348 AS C_24#3334, gps#3349 AS C_25#3335, elev#3342 AS C_22#3336]
         +- Filter ((isnotnull(lon#3341) AND isnotnull(lat#3340)) AND (((lon#3341 <= -104.05) AND (lon#3341 >= -111.05)) AND ((lat#3340 >= 41.0) AND (lat#3340 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#3337,type#3338,name#3339,lat#3340,lon#3341,elev#3342,continent#3343,country#3344,region#3345,city#3346,iata#3347,code#3348,gps#3349] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_22#3336 DESC NULLS LAST], output=[C_13#3323,C_14#3324,C_15#3325,C_16#3326,C_12#3327,C_17#3328,C_18#3329,C_21#3330,C_19#3331,C_20#3332,C_23#3333,C_24#3334,C_25#3335,C_22#3336])
+- *(1) Project [id#3337 AS C_13#3323, type#3338 AS C_14#3324, name#3339 AS C_15#3325, (round((lat#3340 * 1000.0), 0) / 1000.0) AS C_16#3326, (round((lon#3341 * 1000.0), 0) / 1000.0) AS C_12#3327, (round((elev#3342 * 1000.0), 0) / 1000.0) AS C_17#3328, continent#3343 AS C_18#3329, country#3344 AS C_21#3330, region#3345 AS C_19#3331, city#3346 AS C_20#3332, iata#3347 AS C_23#3333, code#3348 AS C_24#3334, gps#3349 AS C_25#3335, elev#3342 AS C_22#3336]
   +- *(1) Filter (((((isnotnull(lon#3341) AND isnotnull(lat#3340)) AND (lon#3341 <= -104.05)) AND (lon#3341 >= -111.05)) AND (lat#3340 >= 41.0)) AND (lat#3340 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#3337,type#3338,name#3339,lat#3340,lon#3341,elev#3342,continent#3343,country#3344,region#3345,city#3346,iata#3347,code#3348,gps#3349] Batched: true, DataFilters: [isnotnull(lon#3341), isnotnull(lat#3340), (lon#3341 <= -104.05), (lon#3341 >= -111.05), (lat#334..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...

== Parsed Logical Plan ==
'GlobalLimit 5
+- 'LocalLimit 5
   +- 'Sort ['C_23 DESC NULLS LAST], true
      +- 'Project ['C_9 AS C_25#2884, 'C_2 AS C_22#2885, 'C_7 AS C_19#2886, 'C_4331 AS C_16#2887, 'C_4332 AS C_18#2888, 'C_4333 AS C_13#2889, 'C_6 AS C_21#2890, 'C_8 AS C_20#2891, 'C_43 AS C_17#2892, 'C_0 AS C_14#2893, 'C_1 AS C_12#2894, 'C_11 AS C_24#2895, 'C_10 AS C_15#2896, 'C_5 AS C_23#2897]
         +- 'SubqueryAlias C_4954424c
            +- 'Project ['C_64656661756c745f616972706f727473.id AS C_9#2868, 'C_64656661756c745f616972706f727473.type AS C_2#2869, 'C_64656661756c745f616972706f727473.name AS C_7#2870, 'C_64656661756c745f616972706f727473.lat AS C_3#2871, 'C_64656661756c745f616972706f727473.lon AS C_4#2872, 'C_64656661756c745f616972706f727473.elev AS C_5#2873, 'C_64656661756c745f616972706f727473.continent AS C_6#2874, 'C_64656661756c745f616972706f727473.country AS C_8#2875, 'C_64656661756c745f616972706f727473.region AS C_43#2876, 'C_64656661756c745f616972706f727473.city AS C_0#2877, 'C_64656661756c745f616972706f727473.iata AS C_1#2878, 'C_64656661756c745f616972706f727473.code AS C_11#2879, 'C_64656661756c745f616972706f727473.gps AS C_10#2880, ('round(('C_64656661756c745f616972706f727473.lat * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4331#2881, ('round(('C_64656661756c745f616972706f727473.lon * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4332#2882, ('round(('C_64656661756c745f616972706f727473.elev * 'power(10.0, 3)), 0) / 'power(10.0, 3)) AS C_4333#2883]
               +- 'Filter ((('C_64656661756c745f616972706f727473.lon <= -104.05) AND ('C_64656661756c745f616972706f727473.lon >= -111.05)) AND (('C_64656661756c745f616972706f727473.lat >= 41.0) AND ('C_64656661756c745f616972706f727473.lat <= 45.0)))
                  +- 'SubqueryAlias C_64656661756c745f616972706f727473
                     +- 'UnresolvedRelation [default, airports], [], false

== Analyzed Logical Plan ==
C_25: string, C_22: string, C_19: string, C_16: double, C_18: double, C_13: double, C_21: string, C_20: string, C_17: string, C_14: string, C_12: string, C_24: string, C_15: string, C_23: double
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_23#2897 DESC NULLS LAST], true
      +- Project [C_9#2868 AS C_25#2884, C_2#2869 AS C_22#2885, C_7#2870 AS C_19#2886, C_4331#2881 AS C_16#2887, C_4332#2882 AS C_18#2888, C_4333#2883 AS C_13#2889, C_6#2874 AS C_21#2890, C_8#2875 AS C_20#2891, C_43#2876 AS C_17#2892, C_0#2877 AS C_14#2893, C_1#2878 AS C_12#2894, C_11#2879 AS C_24#2895, C_10#2880 AS C_15#2896, C_5#2873 AS C_23#2897]
         +- SubqueryAlias C_4954424c
            +- Project [id#2898 AS C_9#2868, type#2899 AS C_2#2869, name#2900 AS C_7#2870, lat#2901 AS C_3#2871, lon#2902 AS C_4#2872, elev#2903 AS C_5#2873, continent#2904 AS C_6#2874, country#2905 AS C_8#2875, region#2906 AS C_43#2876, city#2907 AS C_0#2877, iata#2908 AS C_1#2878, code#2909 AS C_11#2879, gps#2910 AS C_10#2880, (round((lat#2901 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4331#2881, (round((lon#2902 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4332#2882, (round((elev#2903 * POWER(10.0, cast(3 as double))), 0) / POWER(10.0, cast(3 as double))) AS C_4333#2883]
               +- Filter (((lon#2902 <= -104.05) AND (lon#2902 >= -111.05)) AND ((lat#2901 >= 41.0) AND (lat#2901 <= 45.0)))
                  +- SubqueryAlias C_64656661756c745f616972706f727473
                     +- SubqueryAlias spark_catalog.default.airports
                        +- Relation spark_catalog.default.airports[id#2898,type#2899,name#2900,lat#2901,lon#2902,elev#2903,continent#2904,country#2905,region#2906,city#2907,iata#2908,code#2909,gps#2910] parquet

== Optimized Logical Plan ==
GlobalLimit 5
+- LocalLimit 5
   +- Sort [C_23#2897 DESC NULLS LAST], true
      +- Project [id#2898 AS C_25#2884, type#2899 AS C_22#2885, name#2900 AS C_19#2886, (round((lat#2901 * 1000.0), 0) / 1000.0) AS C_16#2887, (round((lon#2902 * 1000.0), 0) / 1000.0) AS C_18#2888, (round((elev#2903 * 1000.0), 0) / 1000.0) AS C_13#2889, continent#2904 AS C_21#2890, country#2905 AS C_20#2891, region#2906 AS C_17#2892, city#2907 AS C_14#2893, iata#2908 AS C_12#2894, code#2909 AS C_24#2895, gps#2910 AS C_15#2896, elev#2903 AS C_23#2897]
         +- Filter ((isnotnull(lon#2902) AND isnotnull(lat#2901)) AND (((lon#2902 <= -104.05) AND (lon#2902 >= -111.05)) AND ((lat#2901 >= 41.0) AND (lat#2901 <= 45.0))))
            +- Relation spark_catalog.default.airports[id#2898,type#2899,name#2900,lat#2901,lon#2902,elev#2903,continent#2904,country#2905,region#2906,city#2907,iata#2908,code#2909,gps#2910] parquet

== Physical Plan ==
TakeOrderedAndProject(limit=5, orderBy=[C_23#2897 DESC NULLS LAST], output=[C_25#2884,C_22#2885,C_19#2886,C_16#2887,C_18#2888,C_13#2889,C_21#2890,C_20#2891,C_17#2892,C_14#2893,C_12#2894,C_24#2895,C_15#2896,C_23#2897])
+- *(1) Project [id#2898 AS C_25#2884, type#2899 AS C_22#2885, name#2900 AS C_19#2886, (round((lat#2901 * 1000.0), 0) / 1000.0) AS C_16#2887, (round((lon#2902 * 1000.0), 0) / 1000.0) AS C_18#2888, (round((elev#2903 * 1000.0), 0) / 1000.0) AS C_13#2889, continent#2904 AS C_21#2890, country#2905 AS C_20#2891, region#2906 AS C_17#2892, city#2907 AS C_14#2893, iata#2908 AS C_12#2894, code#2909 AS C_24#2895, gps#2910 AS C_15#2896, elev#2903 AS C_23#2897]
   +- *(1) Filter (((((isnotnull(lon#2902) AND isnotnull(lat#2901)) AND (lon#2902 <= -104.05)) AND (lon#2902 >= -111.05)) AND (lat#2901 >= 41.0)) AND (lat#2901 <= 45.0))
      +- *(1) ColumnarToRow
         +- FileScan parquet spark_catalog.default.airports[id#2898,type#2899,name#2900,lat#2901,lon#2902,elev#2903,continent#2904,country#2905,region#2906,city#2907,iata#2908,code#2909,gps#2910] Batched: true, DataFilters: [isnotnull(lon#2902), isnotnull(lat#2901), (lon#2902 <= -104.05), (lon#2902 >= -111.05), (lat#290..., Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/home/acdcadmin/spark-warehouse/airports], PartitionFilters: [], PushedFilters: [IsNotNull(lon), IsNotNull(lat), LessThanOrEqual(lon,-104.05), GreaterThanOrEqual(lon,-111.05), G..., ReadSchema: struct<id:string,type:string,name:string,lat:double,lon:double,elev:double,continent:string,count...