FLaNK Stack for 04 December 2023
Tags: apachenifi, apacheflink, apachekafka, opensource
Published: 2023-12-04 15:16:53


## 04-December-2023

For new stuff every working day in December: https://github.com/tspannhw/FLaNK-December2023



### FLaNK Stack Weekly


Tim Spann @PaaSDev

https://pebble.is/PaaSDev

https://vimeo.com/flankstack

https://www.youtube.com/@FLaNK-Stack

https://www.threads.net/@tspannhw

https://medium.com/@tspann/subscribe

Get your new Apache NiFi for Dummies!

https://www.cloudera.com/campaign/apache-nifi-for-dummies.html

https://ossinsight.io/analyze/tspannhw



### CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual. 

[http://www.meetup.com/futureofdata-princeton/](http://www.meetup.com/futureofdata-princeton/)

[https://www.meetup.com/futureofdata-newyork/](https://www.meetup.com/futureofdata-newyork/)

[https://www.meetup.com/futureofdata-philadelphia/](https://www.meetup.com/futureofdata-philadelphia/)


**This is Issue #114 **



[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)

[https://www.cloudera.com/solutions/dim-developer.html](https://www.cloudera.com/solutions/dim-developer.html)


#### Project News

NiFi 2.0.0-M1
https://nifi.apache.org/project-documentation.html

https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0-M1

NiFi 1.24 is out soon with some of the new processors from 2.0.0-M1 and some patches
New Features for 1.24.0

ListenOTLP Processor for collecting OpenTelemetry
EncryptContentAge and DecryptContentAge Processors supporting age-encryption.org specification
YamlTreeReader for YAML as Records
PackageFlowFile Processor for writing file streams and attributes as FlowFile Version 3
Migrated from H2 Database Engine to JetBrains Xodus for storing Flow Configuration History


#### Articles

https://medium.com/cloudera-inc/flank-for-halifax-canada-transit-2d4dc5b8ad64

https://www.slideshare.net/bunkertor/building-realtime-travel-alerts

https://www.slideshare.net/bunkertor/jconworld-continuous-sql-with-kafka-and-flink

https://www.slideshare.net/bunkertor/endss23tspannintegrating-llm-with-streaming-data-pipelines

https://techcrunch.com/2023/11/28/heres-everything-aws-reinvent-2023-so-far/?guccounter=1

https://aimagazine.com/machine-learning/nvidia-and-cloudera-continue-to-advance-ai-technologies

https://ahranemahaganapathy.medium.com/crafting-your-data-flow-a-practical-guide-to-nifi-configuration-f93846d6db3f

https://www.linkedin.com/pulse/rise-autonomous-agents-ashish-bhatia-c4pke/



#### Videos


https://www.youtube.com/watch?v=psnRObquBfw&t=638s&pp=ygUJVGltIFNwYW5u

https://youtu.be/S_faBCNPJgA?si=fZ8EZdxYz2y63BLM


#### Events




On Demand
[https://events.dzone.com/dzone/Data-Pipelines-Investigating-the-Modern-Day-Stack?utm_bmcr_source=LinkedIn](https://events.dzone.com/dzone/Data-Pipelines-Investigating-the-Modern-Day-Stack?utm_bmcr_source=LinkedIn)

Open Source Finance Forum.  Virtual.
[https://resources.finos.org/znglist/osff-2023-virtual-presentations/?c=cG9zdDo5OTEzOTk%3D&utm_campaign=OSFF+NYC+2023&utm_content=269713979&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18473937](https://resources.finos.org/znglist/osff-2023-virtual-presentations/?c=cG9zdDo5OTEzOTk%3D&utm_campaign=OSFF+NYC+2023&utm_content=269713979&utm_medium=social&utm_source=linkedin&hss_channel=lcp-18473937)



December 12-14, 2023:  OSACon.   Online.
[https://osacon.io/](https://osacon.io/)

December 14, 2023:  Flink Fast-Streaming Analytics made easy with SQL Stream Builder. Online. 12PM EST.
[https://attend.cloudera.com/ssb121423](https://attend.cloudera.com/ssb121423)

April 2024: XtremeJ 2024. Virtual.
[https://xtremej.dev/2023/schedule/](https://xtremej.dev/2023/schedule/)


Cloudera Events
[https://www.cloudera.com/about/events.html](https://www.cloudera.com/about/events.html)

More Events:
[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)


#### Code

* https://github.com/tspannhw/FLaNK-EveryTransitSystem
* https://github.com/tspannhw/FLaNK-Ice
* https://github.com/tspannhw/FLaNK-SaoPauloBrazil
* https://github.com/tspannhw/FLaNK-ContinuousSQL
* https://github.com/tspannhw/FLaNK-OpenAi


#### NiFi Processors

* https://github.com/tspannhw/GetWebCamera/releases/tag/3.0

#### Models

* https://github.com/xetdata/onnx-models
* https://github.com/epfLLM/meditron
* https://platform.stability.ai/
* https://github.com/facebookresearch/seamless_communication
* https://huggingface.co/Intel/neural-chat-7b-v3-1
* https://huggingface.co/llmware/dragon-yi-6b-v0
  

#### Tools

* https://oap-project.github.io/gluten/
* https://github.com/facebookincubator/velox
* https://spotify.github.io/voyager/
* https://github.com/cbh123/narrator
* https://threadx.io/
* https://github.com/langchain4j/langchain4j/releases/tag/0.24.0
* https://github.com/microsoft/semantic-kernel
* https://luke.hsiao.dev/blog/housing-documentation/
* https://everydeveloper.com/use-cases-elevate-your-technical-content/
* https://github.com/tjake/Jlama
* https://github.com/VikParuchuri/marker
* https://github.com/facebookresearch/nougat
* https://pymupdf.readthedocs.io/en/latest/about.html#license-and-copyright
* https://github.com/pymupdf/PyMuPDF
* https://huggingface.co/microsoft/layoutlmv3-base
* https://github.com/microsoft/i-Code/tree/main/CoDi-2
* https://github.com/gordonmurray/apache_flink_and_iceberg


&copy; 2020-2023 Tim Spann