FLaNK Stack Weekly for 20 June 2023
Tags: apachenifi, apachekafka, apacheflink, opensource
Published: 2023-06-20 15:07:19

## 20-June-2023

### FLiPN-FLaNK Stack Weekly

Tim Spann @PaaSDev

We are publishing late due to Father's Day and [https://en.wikipedia.org/wiki/Juneteenth](https://en.wikipedia.org/wiki/Juneteenth).   

![happyfathersday](https://github.com/tspannhw/FLiPStackWeekly/blob/main/happyfathersday.jpeg?raw=true)

### NiFI updates

Apache NiFi 1.22 is now available for download!
Release Date: June 11, 2023
MiNiFi agents can now talk to C2 servers using reverse proxy/load balancers.
New processor to support modifying the compression algorithm of content which still incurs the CPU hit substantially improves IO by avoiding writing and reading the intermediary decompressed form.
New processor for Azure Queue Storage using Azure SDK 12.
Put Database Record now allows for Upserts.
Deprecated additional components and features in preparation toward an Apache NiFi 2.0.
Upgraded numerous dependencies due to potential vulnerabilities and latest stable lines.
Numerous bug fixes to processors but also core NiFi framework behavior
A full list of issues that were resolved can be found at: 
[https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12353069](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12353069)

[https://cwiki.apache.org/confluence/display/NIFI/Deprecated+Components+and+Features](https://cwiki.apache.org/confluence/display/NIFI/Deprecated+Components+and+Features)

## CODE + COMMUNITY


Please join my meetup group NJ/NYC/Philly/Virtual. 

[http://www.meetup.com/futureofdata-princeton/](http://www.meetup.com/futureofdata-princeton/)

[https://www.meetup.com/futureofdata-newyork/](https://www.meetup.com/futureofdata-newyork/)

[https://www.meetup.com/futureofdata-philadelphia/](https://www.meetup.com/futureofdata-philadelphia/)


**This is Issue #90 **

You may notice a version jump, Linked in says we had 89 already, so I am assuming two other articles got assimilated.   I will go with this, since 90 is a better number.

[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)



### Videos

[https://www.youtube.com/watch?v=_uYp8s6_6GA&t=1s&pp=ygUQIlRpbSBzcGFubiIgbmlmaQ%3D%3D](https://www.youtube.com/watch?v=_uYp8s6_6GA&t=1s&pp=ygUQIlRpbSBzcGFubiIgbmlmaQ%3D%3D)

[https://www.cloudera.com/about/events/cloudera-now-cdp.html](https://www.cloudera.com/about/events/cloudera-now-cdp.html)


### Articles

[https://dzone.com/articles/harnessing-the-power-of-nifi-building-a-seamless-f](https://dzone.com/articles/harnessing-the-power-of-nifi-building-a-seamless-f)

[https://medium.com/@tspann/apache-nifi-1-22-updates-e658eaff3308](https://medium.com/@tspann/apache-nifi-1-22-updates-e658eaff3308)

[https://medium.com/@tspann/harnessing-the-power-of-nifi-building-a-seamless-flow-to-ingest-pm2-5-90246393fcab](https://medium.com/@tspann/harnessing-the-power-of-nifi-building-a-seamless-flow-to-ingest-pm2-5-90246393fcab)

[https://blog.cloudera.com/one-big-cluster-stuck-platform-health/](https://blog.cloudera.com/one-big-cluster-stuck-platform-health/)

[https://medium.com/@ayushtkn/apache-hive-esri-geospatial-support-5ca815daaa7e](https://medium.com/@ayushtkn/apache-hive-esri-geospatial-support-5ca815daaa7e)

[https://medium.com/@kiranprabhu/kafka-topic-naming-conventions-best-practices-6b6b332769a3](https://medium.com/@kiranprabhu/kafka-topic-naming-conventions-best-practices-6b6b332769a3)

[https://www.datanami.com/2023/01/30/five-drivers-behind-the-rapid-rise-of-apache-flink/](https://www.datanami.com/2023/01/30/five-drivers-behind-the-rapid-rise-of-apache-flink/)

[https://webtechie.be/post/2023-06-15-crac-on-raspberry-pi/](https://webtechie.be/post/2023-06-15-crac-on-raspberry-pi/)

[https://www.cdc.gov/nbs/modernization/stories/202304.html](https://www.cdc.gov/nbs/modernization/stories/202304.html)

[https://www.smarthomebeginner.com/podman-vs-docker/](https://www.smarthomebeginner.com/podman-vs-docker/)

[https://speakerdeck.com/stevenz3wu/streaming-from-apache-iceberg-qcon-ny-2023?slide=8](https://speakerdeck.com/stevenz3wu/streaming-from-apache-iceberg-qcon-ny-2023?slide=8)

[https://thenewstack.io/kelsey-hightower-predicts-how-the-kubernetes-community-will-evolve/](https://thenewstack.io/kelsey-hightower-predicts-how-the-kubernetes-community-will-evolve/)


### Recent Talks


[https://www.youtube.com/watch?v=Ws7YmAHE1O8](https://www.youtube.com/watch?v=Ws7YmAHE1O8)

[https://www.cloudera.com/about/events/evolve.html](https://www.cloudera.com/about/events/evolve.html)

[https://speakerdeck.com/stevenz3wu/streaming-from-apache-iceberg-qcon-ny-2023](https://speakerdeck.com/stevenz3wu/streaming-from-apache-iceberg-qcon-ny-2023)


### Events


June 26-28, 2023:  NLIT Summit.  Milwaukee.  
[https://www.fbcinc.com/e/nlit/default.aspx](https://www.fbcinc.com/e/nlit/default.aspx)

June 28, 2023:  NiFi Meetup.   Milwaukee and Hybrid.
[https://www.meetup.com/futureofdata-princeton/events/292976004/](https://www.meetup.com/futureofdata-princeton/events/292976004/)

![meetup](https://raw.githubusercontent.com/tspannhw/FLiPStackWeekly/main/images/junemeetup.jpg)

July 19, 2023:   2-Hours to Data Innovation:   Data Flow
[https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html](https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html)

October 18, 2023:  2-Hours to Data Innovation:   Data Flow
[https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html](https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html)

Cloudera Events
[https://www.cloudera.com/about/events.html](https://www.cloudera.com/about/events.html)

More Events:
[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)


### LLM Generated Code

* [https://github.com/tspannhw/FLaNK-LLM/tree/main/hyper](https://github.com/tspannhw/FLaNK-LLM/tree/main/hyper)

![hyperflank](https://raw.githubusercontent.com/tspannhw/FLaNK-LLM/main/hyper/2023-06-12_13-36-42_000.png)

### Code

* [https://github.com/tspannhw/FLaNK-ParticulateMatterSensor](https://github.com/tspannhw/FLaNK-ParticulateMatterSensor)
* [https://hub.docker.com/r/apache/hive](https://hub.docker.com/r/apache/hive)
* [https://impala.apache.org/docs/build/html/topics/impala_iceberg.html](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html)

### NiFi Code

* [https://github.com/tspannhw/FLaNK-CDC/blob/main/flinkcdc.MD](https://github.com/tspannhw/FLaNK-CDC/blob/main/flinkcdc.MD)
* [https://github.com/tspannhw/FLaNK-CDC/blob/main/kafkacdc.md](https://github.com/tspannhw/FLaNK-CDC/blob/main/kafkacdc.md)
* [https://mvnrepository.com/artifact/org.apache.nifi/nifi-media-nar/1.22.0](https://mvnrepository.com/artifact/org.apache.nifi/nifi-media-nar/1.22.0)
* [https://github.com/tspannhw/FLaNK-NARs](https://github.com/tspannhw/FLaNK-NARs)
* [https://github.com/tspannhw/FLaNK-Edge](https://github.com/tspannhw/FLaNK-Edge)
* [https://github.com/tspannhw/FLaNK-ParticulateMatterSensor](https://github.com/tspannhw/FLaNK-ParticulateMatterSensor)
* [https://github.com/tspannhw/FLaNK-LLM](https://github.com/tspannhw/FLaNK-LLM)

### Tools

* [https://github.com/stanfordroboticsclub/StanfordQuadruped](https://github.com/stanfordroboticsclub/StanfordQuadruped)
* [https://www.newsletter.swirlai.com/p/sai-notes-03-apache-flink-architecture](https://www.newsletter.swirlai.com/p/sai-notes-03-apache-flink-architecture)
* [https://github.com/AI4Finance-Foundation/FinGPT](https://github.com/AI4Finance-Foundation/FinGPT)
* [https://github.com/jedisct1/libsodium](https://github.com/jedisct1/libsodium)
* [https://waabi.ai/oyster/](https://waabi.ai/oyster/)
* [https://www.baeldung.com/gatling-load-testing-rest-endpoint](https://www.baeldung.com/gatling-load-testing-rest-endpoint)
* [https://github.com/alibaba/fastjson2](https://github.com/alibaba/fastjson2)
* [https://federatedscope.io/docs/algozoo/](https://federatedscope.io/docs/algozoo/)
* [https://designable-antd.formilyjs.org/](https://designable-antd.formilyjs.org/)
* ChatGPT Mac/Windows App for SQL [https://github.com/alibaba/Chat2DB](https://github.com/alibaba/Chat2DB)
* [https://github.com/alibaba/arthas](https://github.com/alibaba/arthas)
* Recommendation Framework [https://github.com/alibaba/EasyRec](https://github.com/alibaba/EasyRec)
* All in One Computer Vision [https://github.com/alibaba/EasyCV](https://github.com/alibaba/EasyCV)
* [https://github.com/alibaba/EasyCV/blob/master/docs/source/tutorials/cls.md](https://github.com/alibaba/EasyCV/blob/master/docs/source/tutorials/cls.md)
* Model as a Service [https://github.com/modelscope/modelscope](https://github.com/modelscope/modelscope)
* CDC from MySQL [https://github.com/alibaba/canal/wiki/Docker-QuickStart](https://github.com/alibaba/canal/wiki/Docker-QuickStart)
* Feature Hub for Flink and Spark [https://github.com/alibaba/feathub](https://github.com/alibaba/feathub)
* [https://jsoup.org/](https://jsoup.org/)
* [https://github.com/dask-contrib/dask-sql](https://github.com/dask-contrib/dask-sql)
* [https://github.com/leondz/garak/](https://github.com/leondz/garak/)
* [https://github.com/zilliztech/VectorDBBench](https://github.com/zilliztech/VectorDBBench)
* M1! [https://github.com/apple/ml-stable-diffusion](https://github.com/apple/ml-stable-diffusion)
* Fun game [https://pixelastic.github.io/pokemonorbigdata/](https://pixelastic.github.io/pokemonorbigdata/)
* [https://github.com/tloen/alpaca-lora](https://github.com/tloen/alpaca-lora)
* [https://shishirpatil.github.io/gorilla/](https://shishirpatil.github.io/gorilla/)
* [https://github.com/boyter/cs?](https://github.com/boyter/cs?)
* [https://github.com/algolia/autocomplete?](https://github.com/algolia/autocomplete?)
* [https://github.com/lmorg/murex](https://github.com/lmorg/murex)
* [https://github.com/keephq/keep](https://github.com/keephq/keep)
* [https://github.com/Safiullah-Rahu/CSV-AI](https://github.com/Safiullah-Rahu/CSV-AI)
* [https://github.com/naushadh/hive-metastore](https://github.com/naushadh/hive-metastore)
* [https://github.com/bentoml/OpenLLM](https://github.com/bentoml/OpenLLM)
* [https://bucket4j.com/](https://bucket4j.com/)
* [https://github.com/dainiusjocas/lucene-grep](https://github.com/dainiusjocas/lucene-grep)
* [https://gpt4all.io/index.html](https://gpt4all.io/index.html)
* [https://github.com/AntonOsika/gpt-engineer](https://github.com/AntonOsika/gpt-engineer)
* [https://github.com/linux-china/chatgpt-spring-boot-starter](https://github.com/linux-china/chatgpt-spring-boot-starter)
* [https://jsoncrack.com/](https://jsoncrack.com/)
* [https://github.com/slidevjs/slidev](https://github.com/slidevjs/slidev)
* [https://docs.flowman.io/en/latest/index.html](https://docs.flowman.io/en/latest/index.html)
* [https://github.com/brexhq/prompt-engineering](https://github.com/brexhq/prompt-engineering)
* [https://replicate.com/andreasjansson/musicgen-looper](https://replicate.com/andreasjansson/musicgen-looper)
* [https://omnimotion.github.io/](https://omnimotion.github.io/)

&copy; 2020-2023 Tim Spann