FLaNK Stack Weekly 5 September 2023
Tags: apacheflink, opensource, apachekafka, apachenifi
Published: 2023-09-05 16:25:47

## 05-September-2023

### FLiPN-FLaNK Stack Weekly

Tim Spann @PaaSDev

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

Get your new Apache NiFi for Dummies!

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw


### CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual. 

[http://www.meetup.com/futureofdata-princeton/](http://www.meetup.com/futureofdata-princeton/)

[https://www.meetup.com/futureofdata-newyork/](https://www.meetup.com/futureofdata-newyork/)

[https://www.meetup.com/futureofdata-philadelphia/](https://www.meetup.com/futureofdata-philadelphia/)


**This is Issue #101 **

[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)

[https://www.cloudera.com/solutions/dim-developer.html](https://www.cloudera.com/solutions/dim-developer.html)


My latest talk will be streaming on September 13th on NiFi, Kafka, Flink and LLM.

https://www.cloudera.com/about/events/cloudera-now-cdp.html

Happy Labor Day US!

Flink got added to OSS Chat!   https://osschat.io/chat?project=Flink


#### Releases

NiFi 1.23.2


#### Recent Talk

[https://www.slideshare.net/bunkertor/aidevday-datainmotion-to-supercharge-ai](https://www.slideshare.net/bunkertor/aidevday-datainmotion-to-supercharge-ai)


#### Articles

https://medium.com/@tspann/streaming-llm-with-apache-nifi-huggingface-ad2f0d367468

https://www.amazon.science/news-and-features/amazon-bedrock-offers-access-to-multiple-generative-ai-models?

https://blog.cloudera.com/new-accreditations-for-cloudera-partners/

https://zilliz.com/blog/building-llm-apps-100x-faster-responses-drastic-cost-reduction-using-gptcache?utm_source=linkedin&utm_medium=social&utm_term=zilliz

https://www.deepmind.com/blog/identifying-ai-generated-images-with-synthid

https://medium.com/cloudera-inc/cloudera-flow-management-2-1-6-df34c3061aaf

https://blog.devgenius.io/building-intuition-retrieval-augmented-generation-vs-fine-tuning-3a275363dec1

https://github.com/estebanpdl/osintgpt

https://towardsdatascience.com/when-change-data-capture-wins-271875e3df1a

https://medium.com/cloudera-inc/collecting-netflow-records-with-cloudera-dataflow-f47d9f57c98

https://docs.cloudera.com/cfm/2.1.6/using-flow-library-registry-client/topics/cfm-adding-flow-library-registry-client.html

https://docs.cloudera.com/cfm/2.1.6/nifi-components/index.html

https://antonz.org/mastering-curl/


#### Videos

AICamp - AI Dev Day - NYC 2023 - August 23, 2023 - NiFi + LLM
[https://youtu.be/l0wPG9zXod0?si=Fhy0K0cNwLK29Py8&t=6820](https://youtu.be/l0wPG9zXod0?si=Fhy0K0cNwLK29Py8&t=6820)

https://youtu.be/B2ORocuzSzM?si=PrHtCM2UZZhT1UZk

https://www.youtube.com/watch?app=desktop&v=fyB8aUgT14w&feature=youtu.be#dialog

https://youtu.be/fyB8aUgT14w?si=AiONqsP0zs0vERzs



#### Events

September 13, 2023:   Cloudera Now
[https://www.cloudera.com/about/events/cloudera-now-cdp.html?internal_keyplay=ALL&internal_campaign=FY24-Q3_AMER_Cloudera_Now_WEB_H10&cid=701Hr0000025VuVIAU&internal_link=h10](https://www.cloudera.com/about/events/cloudera-now-cdp.html?internal_keyplay=ALL&internal_campaign=FY24-Q3_AMER_Cloudera_Now_WEB_H10&cid=701Hr0000025VuVIAU&internal_link=h10)

September 14, 2023: SkillUpSeries: Enable a Streaming Change Data Capture (CDC) Solution.  Virtual.
[https://attend.cloudera.com/skillupseriesseptember14](https://attend.cloudera.com/skillupseriesseptember14)

Sept 21, 2023:  Sao Paulo, Brazil.   Evolve
[https://br.cloudera.com/about/events/evolve/sao-paulo.html](https://br.cloudera.com/about/events/evolve/sao-paulo.html)

October 7-10, 2023:  Halifax, CA.   Community over Code.
[https://communityovercode.org/](https://communityovercode.org/)

October 8, 2023:  Streaming Track, Room 102
[https://communityovercode.org/schedule/#Oct8](https://communityovercode.org/schedule/#Oct8)
[https://communityovercode.org/schedule-list/#SG007](https://communityovercode.org/schedule-list/#SG007)
[https://communityovercode.org/schedule-list/#SG011](https://communityovercode.org/schedule-list/#SG011)

October 10, 2023:  Internet of Things Track, Room 109
[https://communityovercode.org/schedule/#Oct10](https://communityovercode.org/schedule/#Oct10)
[https://communityovercode.org/schedule-list/#IOT001](https://communityovercode.org/schedule-list/#IOT001)

October 18, 2023:  2-Hours to Data Innovation:   Data Flow
[https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html](https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html)

November 1, 2023: Open Source Finance Forum.  Virtual.
[https://events.linuxfoundation.org/open-source-finance-forum-new-york/
](https://events.linuxfoundation.org/open-source-finance-forum-new-york/
)
November 2, 2023:  Evolve. NYC
[https://www.cloudera.com/about/events/evolve/new-york.html#register](https://www.cloudera.com/about/events/evolve/new-york.html#register)

November 7, 2023: XtremeJ 2023. Virtual.
[https://xtremej.dev/2023/schedule/](https://xtremej.dev/2023/schedule/)

November 8, 2023: Flink Forward, Seattle.
[https://www.flink-forward.org/seattle-2023](https://www.flink-forward.org/seattle-2023)

November 21, 2023: JCon World. Virtual.
[https://sched.co/1RRWm](https://sched.co/1RRWm)

November 22, 2023: Big Data Conference.   Hybrid  
[https://bigdataconference.eu/](https://bigdataconference.eu/)
[https://events.pinetool.ai/3079/#sessions/101077](https://events.pinetool.ai/3079/#sessions/101077)

Cloudera Events
[https://www.cloudera.com/about/events.html](https://www.cloudera.com/about/events.html)

More Events:
[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)


#### Code

* https://github.com/tspannhw/FLaNK-HuggingFace-BLOOM-LLM
* https://github.com/tspannhw/FLaNK-Halifax

  
#### Tools

* https://github.com/finos/morphir
* https://issues.apache.org/jira/browse/NIFI-8650
* https://solr.apache.org/guide/solr/latest/query-guide/dense-vector-search.html
* https://github.com/runreveal/kawa
* https://github.com/kousen/openaidemo
* https://picogen.io/
* https://github.com/Barre/privaxy
* https://github.com/facebookresearch/llama
* https://huggingface.co/meta-llama
* https://localai.io/
* https://nightlies.apache.org/flink/flink-ml-docs-release-2.3/docs/try-flink-ml/java/build-your-own-project/
* https://softwaremill.com/zookeeper-less-kafka/
* https://www.odbms.org/2023/08/building-llm-apps-with-100x-faster-responses-and-drastic-cost-reduction-using-gptcache/
* https://exceptionfactory.com/posts/2023/08/29/introducing-jagged-for-age-encryption-in-java/
* https://github.com/exceptionfactory/jagged
* https://github.com/magic-research/magic-edit
* https://github.com/google/paxml
* https://github.com/facebookresearch/co-tracker
* https://github.com/RizwanMunawar/yolov7-object-tracking
* https://github.com/zama-ai/concrete-ml
* https://github.com/Paulescu/hands-on-train-and-deploy-ml
* https://github.com/obra/Youtube2Webpage
* http://pepijndevos.nl/2023/07/15/chatlmza.html
* https://github.com/measuredco/puck

Ex-Clouderan, Awesome Guy and Data Scientist Superstar has released some amazing GenAI tools:
You must download these!!!

* https://github.com/victordibia/llmx
* https://microsoft.github.io/lida/




&copy; 2020-2023 Tim Spann