FLaNK Stack Weekly for 20 Nov 2023
Tags: apachenifi, apachekafka, apacheflink, opensource
Published: 2023-11-20 16:51:49

## 20-November-2023

The FLaK Federation is building...

![flank](https://raw.githubusercontent.com/tspannhw/FLaNK-EveryTransitSystem/main/holiday2023flow.jpg)


### FLaNK Stack Weekly


Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

Get your new Apache NiFi for Dummies!

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw



### CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual. 

[http://www.meetup.com/futureofdata-princeton/](http://www.meetup.com/futureofdata-princeton/)

[https://www.meetup.com/futureofdata-newyork/](https://www.meetup.com/futureofdata-newyork/)

[https://www.meetup.com/futureofdata-philadelphia/](https://www.meetup.com/futureofdata-philadelphia/)


**This is Issue #112 **



[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)

[https://www.cloudera.com/solutions/dim-developer.html](https://www.cloudera.com/solutions/dim-developer.html)

[https://www.cloudera.com/products/dataflow/nifi-dataflow-calculator.html?utm_source=twitter&keyplay=data-flow&utm_campaign=FY24-Q2_Content_Globl_Nifi_SS_Tool_Promos&cid=UNGATED&utm_medium=social-organic&pid=11590424099](https://www.cloudera.com/products/dataflow/nifi-dataflow-calculator.html?utm_source=twitter&keyplay=data-flow&utm_campaign=FY24-Q2_Content_Globl_Nifi_SS_Tool_Promos&cid=UNGATED&utm_medium=social-organic&pid=11590424099)

[https://community.cloudera.com/t5/Community-Articles/New-Cloudera-AMP-with-Amazon-Bedrock-Integration-Now/ta-p/377071?utm_medium=social-organic&pid=11547807644
](https://community.cloudera.com/t5/Community-Articles/New-Cloudera-AMP-with-Amazon-Bedrock-Integration-Now/ta-p/377071?utm_medium=social-organic&pid=11547807644)


#### Articles

https://medium.com/@tspann/real-time-slack-bots-powered-by-llm-and-dataflows-770786f8ffd4

https://medium.com/@tspann/transit-in-sao-paulo-brasil-flank-style-eaec6753cc63

https://medium.com/@tspann/iteration-1-building-a-system-to-consume-all-the-real-time-transit-data-in-the-world-at-once-4322b160df9d

https://dzone.com/refcardz/real-time-data-architecture-patterns

https://www.dfrobot.com/blog-13412.html

https://www.morling.dev/blog/can-debezium-lose-events/

https://www.newyorker.com/magazine/2023/11/20/a-coder-considers-the-waning-days-of-the-craft

https://github.com/microsoft/ML-For-Beginners

https://onetable.dev/

https://rmoff.net/2023/11/16/learning-apache-flink-s01e06-the-flink-jdbc-driver/

https://www.martinvigo.com/email2phonenumber/

https://zilliz.com/blog/how-to-build-ai-chatbot-with-Milvus-and-Towhee?utm_source=vendor&utm_medium=referral&utm_campaign=2023-11-06_email_newsletter-display_tns

https://mattjhayes.com/2023/11/14/introduction-to-nifi/

https://www.markhneedham.com/blog/2023/11/15/clickhouse-summing-columns-remote-files/

https://www-ververica-com.cdn.ampproject.org/c/s/www.ververica.com/blog/streamhouse-unveiled?hs_amp=true

https://simonaubury.com/posts/202310_ginai/



#### Videos


https://www.youtube.com/watch?v=virKyKJlaDE

https://www.youtube.com/watch?v=psnRObquBfw&pp=ygUJVGltIFNwYW5u



#### Events


https://www.pingcap.com/htap-summit/sept-2023


On Demand
[https://events.dzone.com/dzone/Data-Pipelines-Investigating-the-Modern-Day-Stack?utm_bmcr_source=LinkedIn](https://events.dzone.com/dzone/Data-Pipelines-Investigating-the-Modern-Day-Stack?utm_bmcr_source=LinkedIn)

Open Source Finance Forum.  Virtual.
[https://resources.finos.org/znglist/osff-2023-virtual-presentations/?c=cG9zdDo5OTEzOTk%3D&utm_campaign=OSFF+NYC+2023&utm_content=269713979&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18473937](https://resources.finos.org/znglist/osff-2023-virtual-presentations/?c=cG9zdDo5OTEzOTk%3D&utm_campaign=OSFF+NYC+2023&utm_content=269713979&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18473937)

November 21, 2023: JCon World. Virtual.

![jcon2023](https://github.com/tspannhw/FLiPStackWeekly/blob/main/images/Timothy%20Spann%20-%20Continuous%20SQL%20with%20Kafka%20and%20Flink.png?raw=true)

[https://sched.co/1RRWm](https://sched.co/1RRWm)

![jcon](https://github.com/tspannhw/FLiPStackWeekly/blob/main/images/JCON_WORLD_2023_Logo.png?raw=true)


November 22, 2023: Big Data Conference.   Hybrid  
[https://bigdataconference.eu/](https://bigdataconference.eu/)
[https://events.pinetool.ai/3079/#sessions/101077](https://events.pinetool.ai/3079/#sessions/101077)

November 23, 2023:  Data Science Summit.  Hybrid. EU
[https://dssconf.pl/en/](https://dssconf.pl/en/)

https://www.slideshare.net/bunkertor/endss23tspannintegrating-llm-with-streaming-data-pipelines

December 12-14, 2023:  OSACon.   Online.
[https://osacon.io/](https://osacon.io/)

April 2024: XtremeJ 2024. Virtual.
[https://xtremej.dev/2023/schedule/](https://xtremej.dev/2023/schedule/)


Cloudera Events
[https://www.cloudera.com/about/events.html](https://www.cloudera.com/about/events.html)

More Events:
[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)


#### Code

* https://github.com/tspannhw/FLaNK-Halifax
* https://github.com/tspannhw/CoC2023
* https://github.com/tspannhw/PaK-Stocks
* https://github.com/tspannhw/FLaNK-EveryTransitSystem
* https://github.com/tspannhw/FLaNK-Ice
* https://github.com/tspannhw/FLaNK-SaoPauloBrazil

#### Models

* https://huggingface.co/kaist-ai/prometheus-13b-v1.0

#### Tools

* https://github.com/cloudera/CML_AMP_Intelligent-QA-Chatbot-with-NiFi-Pinecone-and-Llama2
* https://github.com/xdgrulez/kafi
* https://espresense.com/
* https://github.com/minimaxir/imgbeddings
* https://github.com/kevinbtalbert/CML_AMP-Text-to-Image-with-Stable-Diffusion
* https://github.com/microsoft/torchgeo
* https://github.com/tibs/fish-and-chips-and-kafka-talk
* https://github.com/rezoo/movis
* https://flatpak.org/
* https://huggingface.co/distil-whisper/distil-large-v2
* https://ozone.apache.org/docs/1.3.0/start/runningviadocker.html
* https://kyuubi.readthedocs.io/en/v1.8.0/index.html
* https://github.com/bytewax/awesome-public-real-time-datasets
* https://github.com/pinterest/memq
* https://github.com/AutoMQ/automq-for-kafka
* https://github.com/tembo-io/pgmq
* https://github.com/shashankvemuri/Finance
* https://github.com/apache/superset/tree/latest
* https://github.com/abi/screenshot-to-code
* https://github.com/philippta/flyscrape
* https://github.com/philippta/trip
* https://ebitengine.org/
* https://dosdeck.com/game/doom
* https://dev.to/burakboduroglu/spring-boot-cheat-sheet-460c
* https://github.com/Aiven-Open/sql-cli-for-apache-flink-docker
* https://github.com/alipay/fury
* https://github.com/SCADA-LTS/Scada-LTS
* https://github.com/Aiven-Labs/data-pipeline-evolution-batch-streaming-apache-flink
* https://github.com/Aiven-Open/journalpump
* https://github.com/gmrqs/lasagna
* https://partyrock.aws/
* https://partyrock.aws/u/partyrock/wWo-KNwoS/Podcast-Generator/snapshot/v73OIztx9
* https://partyrock.aws/u/tspannhw/_jbzaohP6/NJ-Transit-Delay-Notifier/snapshot/3SV6mBR9b
* https://www.waitingforcode.com/apache-flink/apache-flink-anatomy-job/read
* https://github.com/yl4579/StyleTTS2
* https://fleuret.org/dlc/
* https://github.com/protectai/ai-exploits
* https://github.com/luxonis/depthai-python
* https://github.com/jzhang38/TinyLlama



&copy; 2020-2023 Tim Spann