Dec 12, 2022 FLiP Stack Weekly
Tags: apachepulsar, apacheflink, opensource, serverless
Published: 2022-12-11 19:27:16

Dec 12, 2022 FLiP Stack Weekly


People are FLiPN out about [https://chat.openai.com/chat](https://chat.openai.com/chat).   It is a game changer, add another few years and this should be 10x better.


ChatGPT wrote me this Pulsar function:

````
import org.apache.pulsar.functions.api.Context;
import org.apache.pulsar.functions.api.Function;

public class BertQAFunction implements Function<String, String> {

  @Override
  public String process(String input, Context context) {
    // Parse the input JSON into a Java object using a JSON library
    // such as Jackson or Gson
    MyJsonObject json = parseJson(input);

    // Use the Bert QA library to perform QA on the JSON object
    BertQAResult result = BertQA.runQA(json);

    // Return the result as a JSON string
    return result.toJson();
  }

}
````

I then tried to build 50 more.  Some are good, some are minimal, some are bad and some are just shells.   An interesting start and some good ideas on functions to build.   I offer the source as a starter for anyone wanting to build some functions.

[https://github.com/tspannhw/pulsar-chatgptgenerated-functions](https://github.com/tspannhw/pulsar-chatgptgenerated-functions)


Check out our channel:

[https://www.youtube.com/@streamnativecommunity8124/featured](https://www.youtube.com/@streamnativecommunity8124/featured)

### New Stuff

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.19.0


A quick preview of Apache Pulsar + Apache Pinot.

![Arch](https://github.com/tspannhw/pulsar-thermal-pinot/raw/main/images/thermalpinot2.png)


[https://youtu.be/KMbTlmoDXXA](https://youtu.be/KMbTlmoDXXA)

[https://github.com/tspannhw/pulsar-thermal-pinot](https://github.com/tspannhw/pulsar-thermal-pinot)


### PODCAST

Take a look at recent podcasts in audio or video format.

[https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams](https://www.buzzsprout.com/2062659/11463086-messaging-streaming-and-events-101-episode-1-of-crossing-the-streams)

[https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt](https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt)

{% embed https://www.youtube.com/watch?v=U8aPBhlvDHU&feature=emb_imp_woyt %}


### CODE + COMMUNITY


Join my meetup group NJ/NYC/Philly/Virtual.  

[https://www.meetup.com/new-york-city-apache-pulsar-meetup/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/
)

**This is Issue #62!!**

[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.linkedin.com/pulse/2022-schedule-tim-spann](https://www.linkedin.com/pulse/2022-schedule-tim-spann)



#### VIDEOS

[https://streamnative.io/download/pulsar-summit-san-francisco-on-demand/?utm_campaign=Pulsar%20Summit%20San%20Francisco%202022%20Videos&utm_source=Sn.io%20website%20event%20page&utm_term=Sn.io%20website%20event%20page%20-%20Pulsar%20Summit%20On-demand](https://streamnative.io/download/pulsar-summit-san-francisco-on-demand/?utm_campaign=Pulsar%20Summit%20San%20Francisco%202022%20Videos&utm_source=Sn.io%20website%20event%20page&utm_term=Sn.io%20website%20event%20page%20-%20Pulsar%20Summit%20On-demand) Collect them all

{% embed https://www.youtube.com/watch?v=gCroAjk5D_Q %}

[https://www.youtube.com/watch?v=gCroAjk5D_Q](https://www.youtube.com/watch?v=gCroAjk5D_Q)

{% embed https://www.youtube.com/embed/gCroAjk5D_Q %}

[https://www.youtube.com/watch?v=Z9zAnKBcGKI](https://www.youtube.com/watch?v=Z9zAnKBcGKI)

{% embed https://www.youtube.com/watch?v=Z9zAnKBcGKI %}


[https://www.youtube.com/watch?v=VhVs6fuf7W8](https://www.youtube.com/watch?v=VhVs6fuf7W8)

{% embed https://www.youtube.com/watch?v=VhVs6fuf7W8 %}

[https://www.youtube.com/watch?v=sJB0Fwxy2ck](https://www.youtube.com/watch?v=sJB0Fwxy2ck)

{% embed https://www.youtube.com/watch?v=sJB0Fwxy2ck %}

[https://www.youtube.com/watch?v=4Fh48IL3rUA](https://www.youtube.com/watch?v=4Fh48IL3rUA)

[https://www.youtube.com/watch?v=vwLxV48JhbQ](https://www.youtube.com/watch?v=vwLxV48JhbQ)

[https://www.youtube.com/watch?v=MN2l1duMjeA](https://www.youtube.com/watch?v=MN2l1duMjeA)

[https://www.youtube.com/watch?v=apY1Xd5JgkA](https://www.youtube.com/watch?v=apY1Xd5JgkA)

[https://www.youtube.com/watch?v=BpXJboPWpAY](https://www.youtube.com/watch?v=BpXJboPWpAY)

[https://www.youtube.com/watch?v=lepXk0u4iQ4](https://www.youtube.com/watch?v=lepXk0u4iQ4)

[https://www.youtube.com/watch?v=v7qYBQVFz_k](https://www.youtube.com/watch?v=v7qYBQVFz_k)

[https://www.youtube.com/watch?v=txidgG7xcYE](https://www.youtube.com/watch?v=txidgG7xcYE)

[https://www.youtube.com/watch?v=wNkdH1A7C_s](https://www.youtube.com/watch?v=wNkdH1A7C_s)




#### ARTICLES

[https://streamnative.io/blog/case/2022-12-05-wechat-using-apache-pulsar-to-support-the-high-throughput-real-time-recommendation-service/](https://streamnative.io/blog/case/2022-12-05-wechat-using-apache-pulsar-to-support-the-high-throughput-real-time-recommendation-service/)

[https://medium.com/@isuriamasarani87/why-http-is-a-bad-idea-for-microservices-f82e99eff9a0](https://medium.com/@isuriamasarani87/why-http-is-a-bad-idea-for-microservices-f82e99eff9a0)

[https://medium.com/@tspann/having-chatgpt-build-lightweight-stateless-streaming-microservices-for-me-a865e4475bf2](https://medium.com/@tspann/having-chatgpt-build-lightweight-stateless-streaming-microservices-for-me-a865e4475bf2)

[https://medium.com/@tspann/using-apache-pulsar-with-cloudera-sql-builder-apache-flink-b518aa9eadff](https://medium.com/@tspann/using-apache-pulsar-with-cloudera-sql-builder-apache-flink-b518aa9eadff)

[https://www.infoq.com/articles/serverless-websockets-realtime-messaging/](https://www.infoq.com/articles/serverless-websockets-realtime-messaging/)

[https://ververica.zendesk.com/hc/en-us/articles/6824103650076-How-to-Integrate-Ververica-Platform-with-Apache-Pulsar](https://ververica.zendesk.com/hc/en-us/articles/6824103650076-How-to-Integrate-Ververica-Platform-with-Apache-Pulsar)

[https://blogs.oracle.com/java/post/go-native-with-spring-boot-3-and-graalvm](https://blogs.oracle.com/java/post/go-native-with-spring-boot-3-and-graalvm)

[https://medium.com/@nifi.notes/building-an-effective-nifi-flow-queryrecord-cca5ba51afd5](https://medium.com/@nifi.notes/building-an-effective-nifi-flow-queryrecord-cca5ba51afd5)

[https://medium.com/@nifi.notes/building-an-effective-nifi-flow-b5aa1b816380](https://medium.com/@nifi.notes/building-an-effective-nifi-flow-b5aa1b816380)

[http://funnifi.blogspot.com/2022/12/using-updatedatabaserecord-for-schema.html](http://funnifi.blogspot.com/2022/12/using-updatedatabaserecord-for-schema.html)

[https://vinodhini-sd.medium.com/what-is-chatgpt-is-it-really-coming-for-your-job-why-should-you-care-3dd6bfe74339](https://vinodhini-sd.medium.com/what-is-chatgpt-is-it-really-coming-for-your-job-why-should-you-care-3dd6bfe74339)

[https://www.infoq.com/news/2022/10/apache-inlong-framework/](https://www.infoq.com/news/2022/10/apache-inlong-framework/)

[https://www.infoq.com/articles/streaming-first-real-time-ml/](https://www.infoq.com/articles/streaming-first-real-time-ml/)

[https://www.infoq.com/presentations/ml-continuous-learning/](https://www.infoq.com/presentations/ml-continuous-learning/)

[https://dev.to/_hs_/micronaut-pulsar-6bo](https://dev.to/_hs_/micronaut-pulsar-6bo)

[https://nakedsecurity.sophos.com/2022/12/08/credit-card-skimming-the-long-and-winding-road-of-supply-chain-failure/](https://nakedsecurity.sophos.com/2022/12/08/credit-card-skimming-the-long-and-winding-road-of-supply-chain-failure/)

[https://blog.rockthejvm.com/pulsar-flink/](https://blog.rockthejvm.com/pulsar-flink/)

[https://dzone.com/articles/how-to-choose-the-right-messaging-system-for-your](https://dzone.com/articles/how-to-choose-the-right-messaging-system-for-your)

[https://pulsar.apache.org/docs/2.10.x/cookbooks-non-persistent/](https://pulsar.apache.org/docs/2.10.x/cookbooks-non-persistent/)

[https://towardsdatascience.com/whats-next-for-data-engineering-in-2023-7-predictions-b57e3c1bf2d3](https://towardsdatascience.com/whats-next-for-data-engineering-in-2023-7-predictions-b57e3c1bf2d3)



#### TRAINING


Dates are January 17 - 19, 2023 from 2pm - 5pm CET / 8am - 12pm EST
Link to register: [https://www.eventbrite.com/e/465055021087](https://www.eventbrite.com/e/465055021087)

[https://streamnative.io/training/](https://streamnative.io/training/)


#### CODE

[https://github.com/tspannhw/pulsar-csp-ce](https://github.com/tspannhw/pulsar-csp-ce)

[https://github.com/tspannhw/pulsar-thermal-pinot](https://github.com/tspannhw/pulsar-thermal-pinot)

[https://github.com/tspannhw/create-nifi-pulsar-flink-apps](https://github.com/tspannhw/create-nifi-pulsar-flink-apps)

[https://github.com/flipkart-incubator/pulsar-weighted-consumer](https://github.com/flipkart-incubator/pulsar-weighted-consumer)

[https://docs.dapr.io/reference/components-reference/supported-pubsub/setup-pulsar/](https://docs.dapr.io/reference/components-reference/supported-pubsub/setup-pulsar/)

[https://github.com/micronaut-projects/micronaut-pulsar/tree/master/examples/full-java-example](https://github.com/micronaut-projects/micronaut-pulsar/tree/master/examples/full-java-example)



### EVENTS


Dec 14, 2022: Manhattan, NYC:  Pulsar + Pinot Meetup

[https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289817171/)


Dec 15, 2022: TigerLabs, Princeton, NJ: Pulsar + NiFi + Flink Meetup

[https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/](https://www.meetup.com/new-york-city-apache-pulsar-meetup/events/289674210/)


Data Science Camp Online

[https://dscamp.org/](https://dscamp.org/)


Feb 15, 2023:  Scylla Summit.  Virtual

[https://www.scylladb.com/scylladb-summit-2023/](https://www.scylladb.com/scylladb-summit-2023/)


**HTAP Summit**

Coming soon.


**Pinot / Pulsar Meetup**

Coming soon.

**CockroachDB NYC Meetup**


**Hazelcast Event**

[https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector](https://docs.hazelcast.com/hazelcast/5.1/integrate/pulsar-connector)


### TOOLS


* [https://bret.dk/pi-zero-showdown/](https://bret.dk/pi-zero-showdown/)
* [https://mangopi.org/mangopi_mqpro](https://mangopi.org/mangopi_mqpro)
* [https://github.com/ananthdurai/schemata](https://github.com/ananthdurai/schemata)
* [https://github.com/mattkrick/trebuchet-client](https://github.com/mattkrick/trebuchet-client)
* [https://archive.ph/2022.12.07-180110/https://git.herrbischoff.com/awesome-macos-command-line/about/](https://archive.ph/2022.12.07-180110/https://git.herrbischoff.com/awesome-macos-command-line/about/)
* [https://marketplace.visualstudio.com/items?itemName=chunkypixel.atari-dev-studio](https://marketplace.visualstudio.com/items?itemName=chunkypixel.atari-dev-studio)
* [https://github.com/max-sixty/aoc-gpt](https://github.com/max-sixty/aoc-gpt)
* [https://github.com/willmcgugan/faqtory](https://github.com/willmcgugan/faqtory)
* [https://github.com/daochenzha/dreamshard](https://github.com/daochenzha/dreamshard)
* [https://www.githubtrends.io/](https://www.githubtrends.io/)
* [https://github.com/monoid-privacy/monoid](https://github.com/monoid-privacy/monoid)
* [https://github.com/RomanHotsiy/commitgpt](https://github.com/RomanHotsiy/commitgpt)
* [https://github.com/ehmicky/modern-errors](https://github.com/ehmicky/modern-errors)
* [https://github.com/wong2/chat-gpt-google-extension](https://github.com/wong2/chat-gpt-google-extension)
* [https://www.warp.dev/](https://www.warp.dev/)
* [https://github.com/niedzielski/cb](https://github.com/niedzielski/cb)
* [https://seatunnel.apache.org/docs/connector-v2/source/pulsar](https://seatunnel.apache.org/docs/connector-v2/source/pulsar)
* [https://github.com/facebook/prophet](https://github.com/facebook/prophet)
* [https://github.com/albfan/miraclecast](https://github.com/albfan/miraclecast)
* [A Hackable text editor](https://pulsar-edit.dev/)


#### TIPS

````

docker exec -it pulsar bin/pulsar-admin topics get-retention persistent://public/default/items

````

Another tip is don't run ChatGPT created functions on a cluster.


#### JOBS

[https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a](https://jobs.lever.co/stream-native/74d75fc1-1ad7-40a0-b907-66d8ac86009a)