Project: Beam (App Definition and Development / Streaming & Messaging)
File: beam-2.32.0.md

title: "Apache Beam 2.32.0" date: 2021-08-25 00:00:01 -0800 categories: blog release authors: angoenka <!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> We are happy to present the new 2.32.0 release of Apache Beam. This release includes both improvements and new functionality. See the for this release. <!-- more --> For more information on changes in 2.32.0, check out the . The [Beam DataFrame API](/documentation/dsls/dataframes/overview/) is no longer experimental! We've spent the time since the [2.26.0 preview announcement](/blog/dataframe-api-preview-available/) implementing the most frequently used pandas operations (), improving and , adding , integrating DataFrames with [interactive Beam](https://beam.apache.org/releases/pydoc/current/apachebeam.runners.interactive.interactivebeam.html), and of course finding and fixing . Leaving experimental just means that we now have high confidence in the API and recommend its use for production workloads. We will continue to improve the API, guided by your . Added ability to use JdbcIO.Write.withResults without statement and preparedStatementSetter. () Added ability to register URI schemes to use the S3 protocol via FileIO. (). Respect number of shards set in SnowflakeWrite batch mode. () Java SDK: Update Google Cloud Healthcare IO connectors from using v1beta1 to using the GA version. Add support to convert Beam Schema to Avro Schema for JDBC LogicalTypes: `VARCHAR`, `NVARCHAR`, `LONGVARCHAR`, `LONGNVARCHAR`, `DATE`, `TIME` (Java)(). Reading from JDBC source by partitions (Java) (). PubsubIO can now write to a dead-letter topic after a parsing error (Java)(). New append-only option for Elasticsearch sink (Java) ListShards (with DescribeStreamSummary) is used instead of DescribeStream to list shards in Kinesis streams. Due to this change, as mentioned in , for fine-grained IAM policies it is required to update them to allow calls to ListShards and DescribeStreamSummary APIs. For more information, see (). Python GBK will stop supporting unbounded PCollections that have global windowing and a default trigger in Beam 2.33. This can be overriden with `--allowunsafetriggers`. (). Python GBK will start requiring safe triggers or the `--allowunsafetriggers` flag starting with Beam 2.33. (). Fixed race condition in RabbitMqIO causing duplicate acks (Java) ()) According to git shortlog, the following people contributed to the 2.32.0 release. Thank you to all contributors! Ahmet Altay, Ajo Thomas, Alex Amato, Alexey Romanenko, Alex Koay, allenpradeep, Anant Damle, Andrew Pilloud, Ankur Goenka, Ashwin Ramaswami, Benjamin Gonzalez, BenWhitehead, Blake Williams, Boyuan Zhang, Brian Hulette, Chamikara Jayalath, Daniel Oliveira, Daniel Thevessen, daria-malkova, David Cavazos, David Huntsperger, dennisylyung, Dennis Yung, dmkozh, egalpin, emily, Esun Kim, Gabriel Melo de Paula, Harch Vardhan, Heejong Lee, heidimhurst, hoshimura, Iigo San Jose Visiers, Ismal Meja, Jack McCluskey, Jan Lukavsk, Justin King, Kenneth Knowles, KevinGG, Ke Wu, kileys, Kyle Weaver, Luke Cwik, Maksym Skorupskyi, masahitojp, Matthew Ouyang, Matthias Baetens, Matt Rudary, MiguelAnzoWizeline, Miguel Hernandez, Nikita Petunin, Ning Ding, Ning Kang, odidev, Pablo Estrada, Pascal Gillet, rafal.ochyra, raphael.sanamyan, Reuven Lax, Robert Bradshaw, Robert Burke, roger-mike, Ryan McDowell, Sam Rohde, Sam Whittle, Siyuan Chen, Teng Qiu, Tianzi Cai, Tobias Hermann, Tomo Suzuki, tvalentyn, Tyson Hamilton, Udi Meiri, Valentyn Tymofieiev, Vitaly Terentyev, Yichi Zhang, Yifan Mai, yoshiki.obata, Yu Feng, YuqiHuai, yzhang559, Zachary Houfek, zhoufek