Work with pandas-like DataFrames in Apache Beam
Channel: Beam College
Date: 08/06/2022

Presented by Brian Hulette at Beam College 2022.
The Apache Beam Python SDK provides a DataFrame API for working with pandas-like DataFrame objects. This lets you convert a PCollection to a DataFrame and then interact with the DataFrame using the standard methods available on the pandas DataFrame API, providing pandas developers with a familiar programming interface within a Beam pipeline.

Slides: https://github.com/Beam-College/season-2022/blob/main/day2/4-BeamDataFrames.pdf

Notebook: https://github.com/Beam-College/season-2022/blob/main/day2/4-BeamDataFrames-Demo.ipynb