FLaNK AI-April 22, 2024
Tags: apachenifi, apachekafka, apacheflink, generativeai
Published: 2024-04-22 15:35:18

## 22-April-2024

Remembering my local history

https://en.wikipedia.org/wiki/Hightstown_rail_accident

![image](https://github.com/tspannhw/FLiPStackWeekly/assets/18673814/9a119ee9-c8aa-455e-8502-41c711e4dacf)


### FLaNK / KNIFe AI Weekly

http://knifeai.org/

Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw

### CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual. 

[http://www.meetup.com/futureofdata-princeton/](http://www.meetup.com/futureofdata-princeton/)

[https://www.meetup.com/futureofdata-newyork/](https://www.meetup.com/futureofdata-newyork/)

[https://www.meetup.com/futureofdata-philadelphia/](https://www.meetup.com/futureofdata-philadelphia/)

![image](https://github.com/tspannhw/FLiPStackWeekly/assets/18673814/5a9ed187-64a4-48db-b3aa-acbc8828e893)


**This is Issue #134 **

[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.cloudera.com/solutions/dim-developer.html](https://www.cloudera.com/solutions/dim-developer.html)


#### New Releases

https://news.apache.org/foundation/entry/apache-software-foundation-announces-new-top-level-project-apache-paimon

https://www.microsoft.com/en-us/research/project/vasa-1/


#### Talks

https://speakerdeck.com/tspannhw/conf42-llm-adding-generative-ai-to-real-time-streaming-pipelines
https://www.slideshare.net/slideshow/conf42llmadding-generative-ai-to-realtime-streaming-pipelines/267269788

https://speakerdeck.com/tspannhw/nlit-2024-seattle-real-time-ai-streaming-with-cloudera
https://www.slideshare.net/slideshow/april-2024-nlit-cloudera-realtime-llm-streaming-2024/267269851

https://www.slideshare.net/slideshow/realtime-ai-streaming-ai-max-princeton/267269816
https://speakerdeck.com/tspannhw/12-april-2024-princeton-ai-max-conference-cloudera-real-time-ai-streaming


#### Articles

https://www.prnewswire.com/news-releases/lf-ai--data-foundation-launches-open-platform-for-enterprise-ai-opea-for-groundbreaking-enterprise-ai-collaboration-302117979.html

https://medium.com/@tspann/storing-meetup-user-data-as-events-dad3b1dc89f5

https://medium.com/@tspann/real-time-in-boston-part-1-0f92d7da3496


https://medium.com/@tspann/receiving-nasas-gcn-kafka-feed-3863f3c8f7cd


https://medium.com/@tspann/the-fast-track-to-streaming-analytics-with-csp-community-edition-540acb24fdef

https://medium.com/@tspann/april-conference-s-wrap-up-d901d26238b9

https://www.princeton.edu/news/2024/04/15/nj-ai-summit-spotlights-extraordinary-opportunity-lead-ai-technology-and-its

https://medium.com/snowflake/change-data-capture-cdc-with-nifi-and-snowflake-9e93f4ee7b8f

https://towardsdev.com/build-kafka-nifi-clickhouse-in-docker-part-i-45fa08ffb5e3

https://medium.com/@esdraslimasilva83/working-with-csv-and-nifi-febc942c7d60

https://news.apache.org/foundation/entry/apache-software-foundation-announces-new-top-level-project-apache-paimon

https://newatlas.com/outdoors/dnsys-x1-all-terrain-exoskeleton/


https://www.tomshardware.com/tech-industry/quantum-computing/commodore-64-outperforms-ibms-quantum-systems-1-mhz-computer-said-to-be-faster-more-efficient-and-decently-accurate


https://www.datanami.com/2024/04/08/ibm-patents-a-faster-method-to-train-llms-for-enterprises/

https://www.comet.com/site/blog/the-importance-of-data-pipelines-in-the-era-of-generative-ai

https://www.decodable.co/blog/flink-sql-misconfiguration-misunderstanding-and-mishaps?u


https://www.ncsc.gov.uk/collection/guidelines-secure-ai-system-development


https://www.logitech.com/en-us/software/logi-ai-prompt-builder.html?

https://dzone.com/refcardz/getting-started-with-vector-databases



#### Videos

Building Real-Time Pipelines
XTremeJ
https://www.youtube.com/watch?v=SszeF57IdW4

Adding Generative AI to Real-Time Streaming Pipelines | Tim Spann | Conf42 LLMs 2024
https://www.youtube.com/watch?v=Yeua8NlzQ3Y

Meetup Talk NYC
https://youtu.be/u8XNNEPEnKQ?si=VWe6n8OKOF7qk6Fl

https://www.conf42.com/Large_Language_Models_LLMs_2024_Tim_Spann_generative_ai_streaming

https://www.youtube.com/watch?v=fciswxMLfIM&ab_channel=DATAMINER

https://www.youtube.com/watch?v=y6kbRZae4TI&ab_channel=DATAMINER


#### Slides

https://www.slideshare.net/slideshow/april-2024-nlit-cloudera-realtime-llm-streaming-2024/267269851
https://www.slideshare.net/slideshow/realtime-ai-streaming-ai-max-princeton/267269816
https://www.slideshare.net/slideshow/conf42llmadding-generative-ai-to-realtime-streaming-pipelines/267269788

#### Events


April 24/25, 2024:   Cloudera.   Virtual.
EMEA | APAC: April 24, 2024 9:30 AM CEST | 1:00 PM IST
AMER EVENT: Apr 25, 2024 9:00 AM PDT | 12:00 PM EDT
Register Now: http://spr.ly/6047Z3AjN

May 1, 2024:  Gen AI in the Enterprise Cloud.  Virtual.
https://www.linkedin.com/events/7180985346103410688/comments/
https://lu.ma/q7pcfyjn

May 8-9, 2024: Data Summit 2024. Boston, MA.
https://www.dbta.com/DataSummit/2024/default.aspx
https://www.dbta.com/DataSummit/2024/Timothy-Spann.aspx

https://twitter.com/DBTADataSummit/status/1778393005646397636

May 21, 2024:  Gen AI and Beyond with NiFi 2.0.  Virtual.

June 12, 2024: Budapest Data + ML Forum. Virtual.
![image](https://github.com/tspannhw/FLiPStackWeekly/assets/18673814/f7c24719-5ab8-4b4f-87c5-26802234e3f0)
https://budapestdata.hu/2024/en/

Sept 24, 2024:  JConf.Dev. Dallas.
https://2024.jconf.dev/session/598816

Nov 19, 2024: XtremePython. Online.
https://xtremepython.dev/2024/

![tim_v2_1200_628python](https://github.com/tspannhw/FLiPStackWeekly/assets/18673814/b41db3c7-d42c-42e1-924c-eff39cbdbab0)

Cloudera Events
[https://www.cloudera.com/about/events.html](https://www.cloudera.com/about/events.html)

[https://www.cloudera.com/events/cloudera-now-cdp.html?internal_keyplay=ALL&internal_campaign=FY25-Q1-AMER-WS-Cloudera-Now-Events-Page-P06&cid=701Hr000000tW6qIAE&internal_link=p06](https://www.cloudera.com/events/cloudera-now-cdp.html?internal_keyplay=ALL&internal_campaign=FY25-Q1-AMER-WS-Cloudera-Now-Events-Page-P06&cid=701Hr000000tW6qIAE&internal_link=p06)

More Events:
[https://www.linkedin.com/pulse/schedule-2024-tim-spann--y4coe](https://www.linkedin.com/pulse/schedule-2024-tim-spann--y4coe)


#### Code

* https://github.com/tspannhw/FLaNK-python-processors


#### Models

* https://github.com/nlpxucan/WizardLM/tree/main/WizardLM-2
* https://www.kaggle.com/models/google/gemma
* https://www.kaggle.com/models/google/recurrentgemma
* https://www.kaggle.com/models/google/codegemma/pyTorch
* https://huggingface.co/nvidia/canary-1b
* https://huggingface.co/meta-llama/Meta-Llama-3-8B
* https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
* https://huggingface.co/openbmb/MiniCPM-V-2
* https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct



#### Tools

https://flasher.meshtastic.org/

https://axleos.com/building-a-gps-receiver-part-1-hearing-whispers/

https://markdowndown.vercel.app/

https://chat.lmsys.org/?leaderboard

https://github.com/timbertson/python-readability

https://github.com/simonw/llm

https://dave.autonoma.ca/blog/

https://github.com/ozanmakes/scrapedown

https://www.airgradient.com/blog/how-to-determine-error-of-sensor/

https://blocks.tremor.so/

https://developers.telnyx.com/docs/inference/getting_started

https://www.techradar.com/pro/wd-launches-enormous-4tb-sd-card-for-creative-pros-smashes-world-record-for-largest-removable-memory-card-to-smithereens-at-twice-the-capacity-of-biggest-microsd-cards

https://github.com/supabase/index_advisor

https://openfeedback.io/

https://eksctl.io/installation/

https://github.com/bersler/OpenLogReplicator

https://www.spice-space.org/usbredir.html

https://github.com/anthropics/anthropic-cookbook

https://cnjn.org/

https://techunited.co/

https://23orchard.com/

https://entrepreneurs.princeton.edu/tec2024

https://github.com/quixio/quix-streams

https://github.com/huggingface/quanto

https://github.com/huggingface/text-generation-inference

https://nj.tie.org/

https://propelify.com/

https://www.princeton.edu/news/2024/03/18/ai-princeton-pushing-limits-accelerating-discovery-and-serving-humanity

https://www.pppl.gov/research/computational-sciences

https://github.com/apache/incubator-xtable

https://sedona.apache.org/latest/setup/overview/

https://www.timeplus.com/post/1brc-with-timeplus-proton

https://github.com/WINSDK/bite

https://cobalt.tools/

https://github.com/cognitivecomputations/github2file

https://www.fastdownload.io/

https://lapce.dev/

https://mlcommons.org/datasets/dollar-street/

https://foojay.io/today/calling-gemma-with-ollama-testcontainers-and-langchain4j/

https://github.com/glaforge/gemini-workshop-for-java-developers

https://foojay.io/today/getting-started-with-bld/

https://docs.bittensor.com/getting-started/installation

https://huggingface.co/datasets/gretelai/synthetic_text_to_sql

https://github.com/FurkanGozukara/Stable-Diffusion

https://github.com/hpcaitech/ColossalAI

https://www.deepspeed.ai/tutorials/inference-tutorial/

https://llamahub.ai/l/readers/llama-index-readers-file?from=

https://github.com/run-llama/llama-lab

https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md

https://microsoft.github.io/autogen/docs/Getting-Started

https://github.com/mage-ai/mage-ai

https://mempool.space/block/00000000000000000001dcce6ce7c8a45872cafd1fb04732b447a14a91832591

https://quilljs.com/

https://github.com/deep-diver/llamaduo

https://aistudio.google.com/app/prompts/new_chat

https://llm.extractum.io/static/blog/?id=llm-token-pricing

https://quix.io/docs/quix-streams/tutorials/anomaly-detection/tutorial.html#4-check-out-the-results

https://github.com/aishwaryaprabhat/goku/tree/main/goku/dream

https://pytorch-forecasting.readthedocs.io/en/stable/

https://github.com/google-deepmind/penzai

https://github.com/tinyworldmap/tiny-world-map

https://neo4j.com/blog/gql-international-standard/?



#### New

https://opensearch.org/blog/OpenSearch-Flink-Connector/

Native Function Calls on Mistral on OLLAMA
https://twitter.com/ollama/status/1780711997824500047?s=51

#### Classic

https://www.datainmotion.dev/2023/05/best-in-flow-competition-bring-your-own.html

#### Discount

Discount access to DataSummit 2024
https://secure.infotoday.com/RegForms/DataSummit/?Priority=24SPKR


&copy; 2020-2024 Tim Spann