Happenings in the Apache Pulsar Neighborhood- Sept. ‘21
By: Apache Pulsar Neighborhood
Tags: Streaming, Apache Pulsar, Open Source, Messaging

Hello Everyone,

This is the September Apache Pulsar Neighborhood Happenings, where we bring you some of the News, Events, Blogs, YouTube videos, and other findings from around the Apache Pulsar Neighborhood.

2.8 Is Now GA

It had been six months since our last major release, but on 12 June we released 2.8 and we think that it was worth the wait. We have added in the ability to create an Exclusive Producer. By default Apache Pulsar’s producer API provides a “multi-write” to add messages to a topic, but there are use cases were the requirement is to have only one producer. Thus that feature is now available for those that need it.

The Functions API has been a big hit ever since it was added. We have added a number of features that make the management of these of functions easier to manage. We have also simplified the client memory limit settings. In the past, you could control how much memory the internal message queues could use, but it wasn’t as easy as it should have been to set a limit on the overall memory used. Now with 2.8, you can easily set a memory limit.

We don’t want to dive too much into all of the features here, especially since PMC-Chair Matteo Merli and PMC member Sijie Guo wrote a great blog post that you can find on the Apache Pulsar site.

New PMC members and Committers

It has been a busy month here Apache Pulsar and it isn’t slowing down. To help handle the growing workload and to reward their great work for the community, the Project Management Committee announced three new PMC members and one new committer in August.

Enrico Olivelli (GitHub)

Enrico is an open source veteran being a committer on 5 projects (bookkeeper, curator, maven, pulsar, and zookeeper), a PMC member of four of those (bookkeeper, curator, pulsar, and zookeeper) and the PMC-Chair of curator). He has been involved in over 1000 conversations on our channels (second most) and over 100 commits (also second most) this year to our repos. He made his first contribution to Apache Pulsar in September 2020.

Lin Lin (GitHub)

Lin Lin has been contributing a lot the Apache Pulsar project since his first contribution in March of this year, with 29 contributions and he has been involved in 145 conversations. This is Lin Lin’s first appointment to a PMC.

Hang Chen (GitHub)

Hang Chen, as you would expect, has also been contributing a lot to the Apache Pulsar project. This year he has made 29 contributions and made his first post in April 2020 and has answered a lot of questions on WeChat. This is Hang Chen’s first appointment to an Apache PMC.

These three are a great addition to the other members of our PMC, to see a full list of our PMC members, please see our webpage.

Rui Fu (GitHub)

Rui Fu has been nominated and he accepted to become a Committer for Apache Pulsar project. He made his first contribution back in October 2020 and made the 11th most contributions this year (33). While the number of contributions isn’t everything, he has combined that with many comments and suggestions on other’s code. Welcome aboard Rui!

Apache Pulsar Community at ApacheCon

ApacheCon is coming up soon and the Apache Pulsar community is well represented. We have four speakers giving five talks. Here is a partial list. Did we miss someone, please let us know.

API & Microservice

Lari Hotari- Building resilient and scalable API backends with Apache Pulsar and Spring Reactive, Tuesday 15:00 UTC

Ming Luo- Pulsar Beam, HTTP streaming over Apache Pulsar- Wednesday 17:10 UTC-

Big Data: Streaming

Matteo Merli Exclusive Producer: Using Apache Pulsar to build distributed applications, Tuesday 14:10 UTC

Israel Ekpo- Architectures and Trends for Event Stream Processing on Azure with Open Source Software, Wednesday 14:10 UTC-

Matteo Merli- Replicated Subscriptions: taking Apache Pulsar Geo-Replication to next level, Wednesday 15:50 UTC-

Stats of the Month

We had almost 2000 conversations from 260 unique individuals across our Slack, StackOverflow, and GitHub accounts in July (plus a whole lot more when you include our WeChat). And over 250 contributions from 83 different community members, with a quarter of the members being first time contributors. These numbers bring us to over 12k conversations from 750 unique people and 1775 contributions from 240 people. It is quite amazing to see the Apache Pulsar Community grow so much!

Apache Pulsar in the News

Here are some blog posts that we have found from around the web. We think that they are good, but we might not have read them all. Let us know what you have written and we will share it.

Pulsar vs Kafka| comparing Costs and Value

A Deep-dive of Transactions in Apache Pulsar

Why we moved from Apache Kafka to Apache Pulsar

Four Reasons Why Apache Pulsar is Essential to the Modern Data Stack

Apache Pulsar Events

Where are community members speaking? Glad you asked, here is a list:

Meet-ups:

Apache Pulsar and ML - September 14th Noon Pacific, Virtual- Simba Khadder, CEO of Featureform will be speaking with us about Apache Pulsar and ML (more details to come)

- September 14th Noon Pacific, Virtual- Simba Khadder, CEO of Featureform will be speaking with us about Apache Pulsar and ML (more details to come) Apache Pulsar Deep Dive, an end-to-end view of the data flow 15 September 19:00 CEST- Netherlands- Virtual

Past events available on YouTube

Leveraging Pulsar’s Next Gen Streaming Capabilities from a JavaEE Application- August 31, 10 am Pacific, Virtual- PMC member Enrico Olivelli will speaking about Leveraging Pulsar’s Next Gen Streaming Capabilities from a JavaEE Application

If you would like to see where our Meetup groups are around the world, visit the Apache Pulsar Neighborhood Meetup main page. If you would like to help with one of the groups or would like to start your own, please let us know.

Conferences:

ApacheCon 21–23 September (see above)

Pulsar Summit 6 October