Apache Arrow and Go A match made in Data - Matthew Topol
Channel: The ASF
Date: 2023-01-12

Apache Arrow and Go A match made in Data - Matthew Topol
A presentation from ApacheCon 2022

https://apachecon.com/acna2022/slides/01_Topol_Arrow_and_Go.pdf

With Apache Arrow fast becoming a standard for working with data, most people are primarily familiar with the Python, C++ and Java libraries. This talk instead focuses on the Golang implementations of Apache Arrow and Parquet. We'll cover getting started using the Go Arrow and Parquet libraries, creating an Arrow Flight server and client over gRPC, and integrating with other runtimes using the C Data API. The concurrency primitives in Go make it ideal for constructing efficient pipelines for parallel processing of large amounts of data. We'll also cover some of the internals of the implementation to demonstrate how the Go Arrow and Parquet libraries achieve their performance including benefiting from SIMD.