Producing and Consuming Pulsar messages with Apache NiFi
Published: 2021-11-17 17:29:58

---
title: Producing and Consuming Pulsar messages with Apache NiFi
published: true
date: 2021-11-17 01:08:00 UTC
tags: 
canonical_url: 
---

# Producing and Consuming Pulsar messages with Apache NiFi

  

Thanks to Pulsar committer and Author, [David Kjerrumgaard](https://streamnative.io/blog/community/2021-08-03-david-kjerrumgaard-pulsar-in-action-author-talks-all-things-pulsar/), we have a brand new advanced feature Apache NiFi 1.14/1.15 record processor for consuming and producing messages from StreamNative Cloud and any other Apache Pulsar cluster.   I recommend utilizing the latest Apache NiFi 1.15 with Apache Pulsar 2.8.1.
  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEiNV9B3UrTEzfxCVM8gJUKK2vYvf_gdmFTqko01XoMrgV6tzOU1jLIhSyC3ZcwpwbAThYwdntlnDUIB30662z4Qy5d9tqBX5TsTKbpqWJRJ0qxRTxfk0YTTovIiM_pkRyB_SiJPyqjmZncyWNJ_U-eMG7eIksG8RZjFsETrmBZ-6hHdlsHRLopivzc=w640-h548)](https://blogger.googleusercontent.com/img/a/AVvXsEiNV9B3UrTEzfxCVM8gJUKK2vYvf_gdmFTqko01XoMrgV6tzOU1jLIhSyC3ZcwpwbAThYwdntlnDUIB30662z4Qy5d9tqBX5TsTKbpqWJRJ0qxRTxfk0YTTovIiM_pkRyB_SiJPyqjmZncyWNJ_U-eMG7eIksG8RZjFsETrmBZ-6hHdlsHRLopivzc=s1034)

  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEhhpG7xVJfmcJw2GKYrOgc6t_GJmsjhq5Ru0eVVfG5XOh11jrh8AhlNPdfWTqnBmAxXVcvw6rTgM-PzdbLa-J8pAny1NM9uU0iyfgHP5TULmoGrm4WVfQjir2jqp4hualEWCqJP4MpREY500Zyf03Qgx0moIIKaIniUb_E6dv-_wbRm1MYMbsibgQE=w640-h442)](https://blogger.googleusercontent.com/img/a/AVvXsEhhpG7xVJfmcJw2GKYrOgc6t_GJmsjhq5Ru0eVVfG5XOh11jrh8AhlNPdfWTqnBmAxXVcvw6rTgM-PzdbLa-J8pAny1NM9uU0iyfgHP5TULmoGrm4WVfQjir2jqp4hualEWCqJP4MpREY500Zyf03Qgx0moIIKaIniUb_E6dv-_wbRm1MYMbsibgQE=s929)

  

  

  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEiwTuTSq17wRHTb3W_zany6YOO6BHuLWxhz47LXSDqvcg5bQ_8CyBqcS3fIM9bmhiMbzPTXv58EPOslBiD5ZBBf8RQutuzVeLGkLqExx6xmKiDQ33NWFNR5yN43dHg6nfAjPVLMZZNOANCaa_tEfMze2USSM8i8Nxjfu8iznMvE-z-j0h1vhqJCT-8=w640-h542)](https://blogger.googleusercontent.com/img/a/AVvXsEiwTuTSq17wRHTb3W_zany6YOO6BHuLWxhz47LXSDqvcg5bQ_8CyBqcS3fIM9bmhiMbzPTXv58EPOslBiD5ZBBf8RQutuzVeLGkLqExx6xmKiDQ33NWFNR5yN43dHg6nfAjPVLMZZNOANCaa_tEfMze2USSM8i8Nxjfu8iznMvE-z-j0h1vhqJCT-8=s613)
  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEgfF0Kel3nRag0DkOJqikWKGBY6bCTAyBYF5qWSQuYcXSY_zALeuhMYzjxpSESU-eRAe3kN5onK2Ajs0D1Oel4PxF-ik1oyrgMK08GAeuH_qETW-vJRAS38Vr7VQXuhq4-BZ_qwZeoCmS8YPiMR_asfImJLe8EPKvRmMWYSbg0TUO9Y84tcua3efnI=w640-h242)](https://blogger.googleusercontent.com/img/a/AVvXsEgfF0Kel3nRag0DkOJqikWKGBY6bCTAyBYF5qWSQuYcXSY_zALeuhMYzjxpSESU-eRAe3kN5onK2Ajs0D1Oel4PxF-ik1oyrgMK08GAeuH_qETW-vJRAS38Vr7VQXuhq4-BZ_qwZeoCmS8YPiMR_asfImJLe8EPKvRmMWYSbg0TUO9Y84tcua3efnI=s760)

  

  

  

  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEjZa_tN5_OIQrCuwaAYSi_8Tajo-0oBkvA-6MBLmrQaJ1GaaMSdN8kulG2AdFxPUUtTMgnAXrFtx1Z-rlPt4PjnvkHrRlPpyauqQsGN4ijcCwg4D48hTA7kkAn7jpMI_wp8Wow1QfFb1jdQInMBN8i9zgZk6xRI5S2WfXabU_RqQJjWwL8Y5iICrbs=w640-h302)](https://blogger.googleusercontent.com/img/a/AVvXsEjZa_tN5_OIQrCuwaAYSi_8Tajo-0oBkvA-6MBLmrQaJ1GaaMSdN8kulG2AdFxPUUtTMgnAXrFtx1Z-rlPt4PjnvkHrRlPpyauqQsGN4ijcCwg4D48hTA7kkAn7jpMI_wp8Wow1QfFb1jdQInMBN8i9zgZk6xRI5S2WfXabU_RqQJjWwL8Y5iICrbs=s2582)

  

  

  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEgJZhggLnoF9UmOpNkMbbfP7egSIFJiHPiV-dhSYzFo7_N9SaD8x73S-TjMd1eUl-NFEvUf-bnjrpuREzod_KIXuYQkcDhZoWkKWtA2RKFkPvqk7psVOPryQTe1N-9yEpHkPMOHGt-ym6-VpMiOB5-dxY7oeevvqJtCMtYrwnSw18NTmksZ9cUuSwY=w640-h302)](https://blogger.googleusercontent.com/img/a/AVvXsEgJZhggLnoF9UmOpNkMbbfP7egSIFJiHPiV-dhSYzFo7_N9SaD8x73S-TjMd1eUl-NFEvUf-bnjrpuREzod_KIXuYQkcDhZoWkKWtA2RKFkPvqk7psVOPryQTe1N-9yEpHkPMOHGt-ym6-VpMiOB5-dxY7oeevvqJtCMtYrwnSw18NTmksZ9cUuSwY=s2584)
  

  

  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEjvqXGs0HMxJoX2UgwmNVSA8x1tqX-AL2GuFJViQVk2BQ4XtoDq44OclHMF86W4TcsCfV1E7ox1x0qrdVvXa7eBhHGPhezwBh_TqHVkqeVGWZ1_RAdr2QARng575GEPWv8TjlngTpKtevAWIuPcdxLkQv1RqzzNmf0t6LsgYFATBN2HY_hhoEbxA7o=w640-h336)](https://blogger.googleusercontent.com/img/a/AVvXsEjvqXGs0HMxJoX2UgwmNVSA8x1tqX-AL2GuFJViQVk2BQ4XtoDq44OclHMF86W4TcsCfV1E7ox1x0qrdVvXa7eBhHGPhezwBh_TqHVkqeVGWZ1_RAdr2QARng575GEPWv8TjlngTpKtevAWIuPcdxLkQv1RqzzNmf0t6LsgYFATBN2HY_hhoEbxA7o=s2048)

  

  

[![](https://blogger.googleusercontent.com/img/a/AVvXsEhM0wmNXcNE6iZVObQO8YCVlrq-oF7kOum8Xd6B63rGKzsa4OaADxOsAmm5bFTv34ZRBaGyVrHy3-Sbb_o6xcNVxMCptfS5Rh6m8JCf2kBRBTP2Z-6E9Jv3PTzEmnEu0jrCBVbWWL2q74jq1GlfN4X95SpLC4POXSnwO1U6phhzGWzdRSf3eGZIA_E=w640-h334)](https://blogger.googleusercontent.com/img/a/AVvXsEhM0wmNXcNE6iZVObQO8YCVlrq-oF7kOum8Xd6B63rGKzsa4OaADxOsAmm5bFTv34ZRBaGyVrHy3-Sbb_o6xcNVxMCptfS5Rh6m8JCf2kBRBTP2Z-6E9Jv3PTzEmnEu0jrCBVbWWL2q74jq1GlfN4X95SpLC4POXSnwO1U6phhzGWzdRSf3eGZIA_E=s2048)

  

  

  

**Official First NAR Release**

  

  

**Connector**
[https://github.com/david-streamlio/pulsar-nifi-bundle](https://github.com/david-streamlio/pulsar-nifi-bundle)
  

  

<iframe allowfullscreen="" height="499" src="https://www.youtube.com/embed/pfhoF3yTdHU" width="600" youtube-src-id="pfhoF3yTdHU"></iframe>
  

  

  

  

**References**

- [https://www.datainmotion.dev/2019/08/gtfs-real-time-streaming-with-apache.html](https://www.datainmotion.dev/2019/08/gtfs-real-time-streaming-with-apache.html)
- [https://github.com/tspannhw/SpeakerProfile/tree/main/2021/talks](https://github.com/tspannhw/SpeakerProfile/tree/main/2021/talks)
- [https://www.youtube.com/watch?v=pfhoF3yTdHU](https://www.youtube.com/watch?v=pfhoF3yTdHU)
- [https://www.slideshare.net/bunkertor/using-flip-with-influxdb-for-edgeai-iot-at-scale](https://www.slideshare.net/bunkertor/using-flip-with-influxdb-for-edgeai-iot-at-scale)