Fluent Bit - Swiss Army Tool of Observability Data Ingestion - Michael Marshall, Neiman Marcus
Channel: CNCF [Cloud Native Computing Foundation]
Date: 14/05/2021

Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon North America 2021 in Los Angeles, CA from October 12-15. Learn more at https://kubecon.io The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects.

Fluent Bit - Swiss Army Tool of Observability Data Ingestion - Michael Marshall, Neiman Marcus

In this session, Michael will show how Fluent Bit became his Swiss Army tool for observability data ingestion, how he was able to add dynamic log metrics extraction by writing a custom Golang plugin, and as an added bonus, help lower his organization’s AWS costs by selecting Fluent-Bit. Neiman Marcus needed an architecture of both open source log and metrics ingestion projects running in AWS. Michael built out an enterprise quality, fully scalable, performant, solution. All teams began lining up demanding Michael ingest their system and application logs, as soon as possible. On top of this, each team had their own formats and data schema challenges. Michael will share how he overcame those challenges using Fluent Bit. This session is complete with code examples, a brief demo, and lessons learned.