Add Trino 427 release notes

[colebow]

Description

Assemble the release notes for the upcoming Trino 427 release. Fixes #18939

Release notes

(x) This is not user-visible or docs only and no release notes are required.

Verification for each pull request

Format: maintainer, PR/issue number, ✅ / ❌ rn ✅ / ❌ docs
✅ rn - release note added and verified, or assessed to be not necessary, set to ❌ rn before completion
✅ docs - need for docs assessed and merged, or assessed to be not necessary, set to ❌ docs before completion

5 Sep 2023

• Add coercion test coverage for Sequence file #18921 ✅ rn ✅ docs
• Change BlockBuilder to not extend Block #18738 ✅ rn ✅ docs
• Remove legacy Hive readers and writers #18241 ✅ rn ✅ docs
• Fix compile issue #18940 ✅ rn ✅ docs

6 Sep 2023

• Retrieve snapshot id from temporal date version #14214 ✅ rn ✅ docs
• Use access control to filter out redirected tables #18650 ✅ rn ✅ docs
• Add getCurrentLeafSplitsSize metric #18942 ✅ rn ✅ docs
• Handle null value min/max statistics in Delta Lake tables #18920 ✅ rn ✅ docs

7 Sep 2023

• Add support for double to varchar coercion in hive tables #18930 ✅ rn ✅ docs
• Remove split when finished #18958 ✅ rn ✅ docs
• Use OkHttp client in AzureFileSystem #18875 ✅ rn ✅ docs
• Change Hive CSV escape character to backslash when set to double quote #18952 ✅ rn ✅ docs

8 Sep 2023

• Ignore external errors when listing table columns/comments #18970 ✅ rn ✅ docs
• Test cost of information_schena.columns for Delta  #18971 ✅ rn ✅ docs
• Simplify redirection handling code in column listing #18972 ✅ rn ✅ docs
• Cleanup scheduled tasks on completion #18978 ✅ rn ✅ docs
• Introduce MongoMetadataFactory to create MongoMetadata #18968 ✅ rn ✅ docs

9 Sep 2023

• Filter table columns in bulk #18956 ✅ rn ✅ docs

10 Sep 2023

• Multi-join pushdown appends recursively _<number> to column names so that they exceed maximum alias length #18924 ✅ rn ✅ docs
• Distinguish SystemAccessControl methods not exposing query id #18973 ✅ rn ✅ docs
• Test file access count on partitioned tables in Iceberg #18954 ✅ rn ✅ docs
• Extract utility class for creating partition values in Delta Lake #18951 ✅ rn ✅ docs

11 Sep 2023

• Test cleanups #18992 ✅ rn ✅ docs
• Override default implementation of skip(long) method #18977 ✅ rn ✅ docs
• Define separate profile for Azure cloud tests #18996 ✅ rn ✅ docs
• Fix metastores doc #19001 ✅ rn ✅ docs
• Fix broken Azure FileSystem Cloud Tests #19006 ✅ rn ✅ docs

12 Sep 2023

• Push update to connector (All jdbc) #16445 ✅ rn ✅ docs
• Support reading deletion vectors in Delta Lake #17477 ✅ rn ✅ docs
• Reduce access count of checkpoint parquet file in Delta #18919 ✅ rn ✅ docs
• Fix compilation issue #19014 ✅ rn ✅ docs
• Release split source memory when finished #19009 ✅ rn ✅ docs
• Temporarily disable telemetry for JDBC connections #19021 ✅ rn ✅ docs
• Map MySQL TIMESTAMP types to TIMESTAMP WITH TIME ZONE #18470 ✅ rn ✅ docs

13 Sep 2023

• Do not set partition count if it's close to the number of workers #19008 ✅ rn ✅ docs
• Lower KRB ticket lifetime in EnvMultinodeTlsKerberosDelegation #19024 ✅ rn ✅ docs
• Use uniform Assertions AssertJ class #19013 ✅ rn ✅ docs
• Increase GCLocker retry allocation count to avoid OOM too early #19026 ✅ rn ✅ docs
• Fix releasing query scheduler on query completion #19011 ✅ rn ✅ docs
• Add table function for generating Iceberg CDC records #15677 ✅ rn ✅ docs
• Migrate aggregation tests to JUnit #18765 ✅ rn ✅ docs
• Fix elasticsearch like operator get utf8 character length error #18967 ✅ rn ✅ docs
• Rework SQL support section #19000 ✅ rn ✅ docs
• Replace hdp2.6 and cdh5.15 with hdp3.1 #18931 ✅ rn ✅ docs
• Use MISSING_CATALOG_NAME error code #19028 ✅ rn ✅ docs
• Test read FLAT to block builder #19033 ✅ rn ✅ docs

14 Sep 2023

• Read delta lake table history when initial transaction logs are deleted #18845 ✅ rn ✅ docs
• Do not allocate task memory for VALUES/metadata-only queries #19027 ✅ rn ✅ docs
• Allow AbstractTestQueryFramework to run with JUnit #19037 ✅ rn ✅ docs
• Harden testMetadataOnlyQueries #19046 ✅ rn ✅ docs
• Fix dictionary encoded page offsets in parquet writer #19032 ✅ rn ✅ docs
• Optimize column mapping mode tests #18882 ✅ rn ✅ docs
• Add support for writer version 7 in Delta Lake #18423 ✅ rn ✅ docs
• Handle IPv4 mapped addresses in IP contains function #18997 ✅ rn ✅ docs
• Fix delta-lake cloud tests #19048 ✅ rn ✅ docs
• Fix the wrong time unit used for reporting elapsed time in query planing #19047 ✅ rn ✅ docs
• Improve printing of join criteria in PlanPrinter #19041 ✅ rn ✅ docs

15 Sep 2023

• Include enabled roles in QueryContext for event listeners #18994 ✅ rn ✅ docs
• Coerce column type varchar0 to varchar1 for hive table #18811 ✅ rn ✅ docs
• Migrate testMetadataOnlyQueries to blackhole connector #19057 ✅ rn ✅ docs
• Use exact math in flat hash estimated size #19058 ✅ rn ✅ docs

16 Sep 2023

• Use fully qualified functions in planner and optimizer #19035 ✅ rn ✅ docs

17 Sep 2023

• Add FlatHashStrategyCompiler #19059 ✅ rn ✅ docs
• Do not list all tables in testHideDeltaLakeTables #19055 ✅ rn ✅ docs

18 Sep 2023

• Add missing serde/inputFormat combination for Hive #18989 ✅ rn ✅ docs
• Treat overflow error in DATE_ADD as user error #18755 ✅ rn ✅ docs
• Remove unnecessary QualifiedFunctionName #19074 ✅ rn ✅ docs
• Correct header level of inequality pushdown fragment #19080 ✅ rn ✅ docs
• Move special character column mapping mode product tests to integration #19064 ✅ rn ✅ docs
• Update OpenTelemetry to 1.30.1 #19081 ✅ rn ✅ docs
• Update various dependencies #19075 ✅ rn ✅ docs
• Add hive label to trino-filesystem-* changes #19039 ✅ rn ✅ docs

19 Sep 2023

• Avoid quadratic traversal when many columns accessible #19071 ✅ rn ✅ docs
• Optimize Delta files with deletions #19063 ✅ rn ✅ docs
• Fix incorrect banned imports #19089 ✅ rn ✅ docs
• Collapse repeated surefire plugin entries #19088 ✅ rn ✅ docs
• Execute testDynamicFiltering* exclusively #18850 ✅ rn ✅ docs
• Upgrade gitflow-incremental-builder and Maven wrapper #19091 ✅ rn ✅ docs
• Reduce FileSystem calls in LinePageSourceFactory #18959 ✅ rn ✅ docs
• Update speculative flag in NodeLease for running tasks #19093 ✅ rn ✅ docs
• Reduce the test coverage for compatibility against Databricks #18944 ✅ rn ✅ docs
• Add support for writing timestamp_ntz type in Delta #18913 ✅ rn ✅ docs
• Fix inferring type of decimals with leading zeros in MongoDB #19068 ✅ rn ✅ docs

20 Sep 2023

• Eager speculative execution for final LIMIT stages #18862 ✅ rn ✅ docs
• Don't rewrite single small file per partition during Optimize #18938 ✅ rn ✅ docs
• Extract constants for table feature names in Delta Lake #19083 ✅ rn ✅ docs
• Enable testJoinDynamicFilteringMultiJoinOnBucketedTables in Iceberg #19095 ✅ rn ✅ docs
• Make the order of complex grouping key consistent #19103 ✅ rn ✅ docs
• Skip dropping testing Glue database when create time is within threshold #19101 ✅ rn ✅ docs
• Ensure ConnectorSplitSource#close() is called #19109 ✅ rn ✅ docs
• Fix instant file name path retrieval in Hudi Active Timeline #18213 ✅ rn ✅ docs
• Don't start minio for Deltalake's ADLS and GCS smoke test #19098 ✅ rn ✅ docs

21 Sep 2023

• Fix comment in DeltaLakePageSourceProvider.createPageSource #19105 ✅ rn ✅ docs
• Retry on "HTTP Response code: 504" in Databricks tests #19116 ✅ rn ✅ docs
• Avoid re-reading parquet footer for iceberg stats in writer #19090 ✅ rn ✅ docs
• Disable pre-computed hashes by default #19099 ✅ rn ✅ docs
• Add session timezone to QueryCompletedEvent #19118 ✅ rn ✅ docs

22 Sep 2023

• Close ConnectorPageSource when exhausted in CheckpointEntryIterator #19120 ✅ rn ✅ docs
• Upgrade Error Prone to 2.22.0 #19129 ✅ rn ✅ docs
• Support altering column comments in Hive Glue catalogs #19076 ✅ rn ✅ docs
• Handle empty positions in getAddressIndex #19123 ✅ rn ✅ docs
• Update docs readme for Myst Markdown #18937 ✅ rn ✅ docs
• Document PEM format as file format #19019 ✅ rn ✅ docs

25 Sep 2023

• Support Iceberg version travel by reference name #19111 ✅ rn ✅ docs
• Cosmetic enhancements in DeltaLakeWriter #19140 ✅ rn ✅ docs
• Remove SyntheticColumnHandleBuilder #19134 ✅ rn ✅ docs
• Consider memory during writer scaling #18771 ✅ rn ✅ docs
• Avoid re-reading parquet footer for delta stats in writer #19122 ✅ rn ✅ docs
• Add query start to SystemSecurityContext #19141 ✅ rn ✅ docs
• Insert cleanups #19147 ✅ rn ✅ docs
• Avoid exponential DFA in LIKE matcher #19150 ✅ rn ✅ docs

[mosabua]

Suggested change

	* Add support for altering column comments in the Glue catalog. ({issue}`19076`)
	* Add support for `ALTER TABLE ... ALTER COLUMN` with the Glue catalog. ({issue}`19076`)

[colebow]

This would be ALTER TABLE ... ALTER COLUMN ... COMMENT "new comment", which is too much syntax and loses the clarity to saying it in plain speech, IMO.

[ebyhr]

The syntax is wrong. It should be COMMENT ON COLUMN. https://trino.io/docs/current/sql/comment.html

[mosabua]

So thats is not about altering the comment .. but about setting it.. we should use the syntax from @ebyhr then

[ebyhr]

COMMENT ON COLUMN statement can be used for both adding a new comment and altering the existing comment.

The current supported operations of ALTER COLUMN is only changing column types.

[mosabua]

large metadata .. that sounds weird .. is there some better term? a lot of metadata .. is also weird