Project: Beam (App Definition and Development / Streaming & Messaging)
File: beam-2.48.0.md

title: "Apache Beam 2.48.0" date: 2023-05-31 11:30:00 -0400 categories: blog release authors: riteshghorse <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> We are happy to present the new 2.48.0 release of Beam. This release includes both improvements and new functionality. See the for this release. <!--more--> For more information on changes in 2.48.0, check out the . Note: The release tag for Go SDK for this release is sdks/v2.48.2 instead of sdks/v2.48.0 because of incorrect commit attached to the release tag sdks/v2.48.0. "Experimental" annotation cleanup: the annotation and concept have been removed from Beam to avoid the misperception of code as "not ready". Any proposed breaking changes will be subject to case-by-case pro/con decision making (and generally avoided) rather than using the "Experimental" to allow them. Added rename for GCS and copy for local filesystem (Go) (). Added support for enhanced fan-out in KinesisIO.Read (Java) (). This change is not compatible with Flink savepoints created by Beam 2.46.0 applications which had KinesisIO sources. Added textio.ReadWithFilename transform (Go) (). Added fileio.MatchContinuously transform (Go) (). Allow passing service name for google-cloud-profiler (Python) (). Dead letter queue support added to RunInference in Python (). Support added for defining pre/postprocessing operations on the RunInference transform () Adds a Docker Compose based transform service that can be used to discover and use portable Beam transforms (). Passing a tag into MultiProcessShared is now required in the Python SDK (). CloudDebuggerOptions is removed (deprecated in Beam v2.47.0) for Dataflow runner as the Google Cloud Debugger service is . (Java) (). AWS 2 client providers (deprecated in Beam ) are finally removed (). AWS 2 SnsIO.writeAsync (deprecated in Beam v2.37.0 due to risk of data loss) was finally removed (). AWS 2 coders (deprecated in Beam v2.43.0 when adding Schema support for AWS Sdk Pojos) are finally removed (). Fixed Java bootloader failing with Too Long Args due to long classpaths, with a pathing jar. (Java) (). PubsubIO writes will throw SizeLimitExceededException* for any message above 100 bytes, when used in batch (bounded) mode. (Java) (). Long-running Python pipelines might experience a memory leak: . According to git shortlog, the following people contributed to the 2.48.0 release. Thank you to all contributors! Abzal Tuganbay Ahmed Abualsaud Alexey Romanenko Anand Inguva Andrei Gurau Andrey Devyatkin Balzs Nmeth Bazyli Polednia Bruno Volpato Chamikara Jayalath Clay Johnson Damon Daniel Arn Danny McCormick Darkhan Nausharipov Dip Patel Dmitry Repin George Novitskiy Israel Herraiz Jack Dingilian Jack McCluskey Jan Lukavsk Jasper Van den Bossche Jeff Zhang Jeremy Edwards Johanna jeling John Casey Katie Liu Kenneth Knowles Kerry Donny-Clark Kuba Rauch Liam Miller-Cushon MakarkinSAkvelon Mattie Fu Michel Davit Moritz Mack Nick Li Oleh Borysevych Pablo Estrada Pranav Bhandari Pranjal Joshi Rebecca Szper Reuven Lax Ritesh Ghorse Robert Bradshaw Robert Burke Rouslan RuiLong J RyujiTamaki Sam Whittle Sanil Jain Svetak Sundhar Timur Sultanov Tony Tang Udi Meiri Valentyn Tymofieiev Vishal Bhise Vitaly Terentyev Xinyu Liu Yi Hu bullet03 darshan-sj kellen liferoad mokamoka03210120 psolomin