AWS Glue 5.1 is now available in all AWS Commercial and AWS GovCloud (US) Regions
Amazon Web Services has expanded availability of AWS Glue 5.1 to all commercial and GovCloud regions, including the Asia Pacific (New Zealand) and both US GovCloud regions. The serverless data integration service now features significant technical upgrades including Apache Spark 3.5.6, Python 3.11, and Scala 2.12.18, delivering enhanced performance and security capabilities for data processing workloads. The release introduces substantial improvements to open table format support, upgrading to Apache Hudi 1.0.2, Apache Iceberg 1.10.0, and Delta Lake 3.3.2. Notably, AWS Glue 5.1 adds support for Apache Iceberg format version 3.0, bringing advanced features like default column values, deletion vectors for merge-on-read operations, multi-argument transforms, and row lineage tracking. The update also extends AWS Lake Formation's fine-grained access controls to write operations for both DML and DDL commands, expanding beyond the previous read-only limitations and adding comprehensive table-level access controls for Apache Hudi and Delta Lake tables through Apache Spark.
Why It Matters
This release represents a significant advancement in AWS's data lake capabilities, particularly for enterprises requiring sophisticated data governance and security controls. The extension of Lake Formation access controls to write operations addresses a critical gap in data security, while the upgraded table format support positions AWS Glue to handle more complex data architectures and streaming analytics workloads at scale.
This summary is generated using AI analysis of the original press release. Always refer to the original source for complete details.