FLaNK Stack Weekly on 26 June 2023
Tags: apacheflink, opensource, apachenifi, apachekafka
Published: 2023-06-26 01:10:11

## 26-June-2023

### FLiPN-FLaNK Stack Weekly

Tim Spann @PaaSDev

My friend wrote an awesome new book on streaming, I highly recommend picking up a copy!

[https://leanpub.com/streamprocessingwithapacheflink/c/ucQ5dLcZYAo2](https://leanpub.com/streamprocessingwithapacheflink/c/ucQ5dLcZYAo2)


### Join me in person for steak & stack or virtually for FLaNK Stack

[https://www.meetup.com/futureofdata-princeton/events/292976004/](https://www.meetup.com/futureofdata-princeton/events/292976004/)

![meetup](https://github.com/tspannhw/FLiPStackWeekly/blob/main/images/matrixsteak.jpeg?raw=true)


Wednesday, June 28, 2023 at 6:00 PM to Wednesday, June 28, 2023 at 8:00 PM EDT
Add to calendar
The Capital Grille
310 W Wisconsin Ave · Milwaukee, WI

Also live streamed to Youtube

This will be a hybrid event with a Zoom. The in-person event will be in Milwaukee.

In this interactive session, Tim will lead participants through how to best build streaming data pipelines. He will cover how to build applications from some common use cases and highlight tips, tricks, best practices and patterns.
He will show how to build the easy way and then dive deep into the underlying open source technologies including Apache NiFi, Apache Flink, Apache Kafka and Apache Iceberg.
If you wish to follow along, please download open source projects beforehand. You can also download this helpful streaming platform: https://docs.cloudera.com/csp-ce/latest/installation/topics/csp-ce-installing-ce.html
All source code and slides will be shared for those interested in building their own FLaNK Apps. https://www.flankstack.dev/

https://www.thecapitalgrille.com/locations/wi/milwaukee/milwaukee/8027

![cunkflank](https://github.com/tspannhw/FLiPStackWeekly/blob/main/images/cunkonflank.jpg?raw=true)

### Hardware For FLaNK

The amazing team at Ampere Computing sent us a 2U Mt Jade. 

[https://amperecomputing.com/en/systems/altra/2u-mt-jade-2s-nvme](https://amperecomputing.com/en/systems/altra/2u-mt-jade-2s-nvme)

We will be running some AI, IoT, MiNiFi, NiFi, Kafka, Flink, Pulsar, Spark, Iceberg, Ozone, HBase, Kudu, Hive, Impala, Jupyter and more workloads here.


### Updates

*CDF-PC 2.5 on CDP Public Cloud*

[https://docs.cloudera.com/dataflow/cloud/deploy-flows/topics/cdf-flow-deployment-autoscaling.html](https://docs.cloudera.com/dataflow/cloud/deploy-flows/topics/cdf-flow-deployment-autoscaling.html)

New Advanced UIs: 
* The Flow Designer now supports the advanced configuration UI for UpdateAttribute.
* The Flow Designer now supports the advanced configuration UI for JoltTransformJson.
* New Canvas navigation: The Flow Designer now supports Birdseye and Zoom controls.
* New troubleshooting: The Flow Designer now supports Processor Diagnostics with an active Test Session.
* Multi-Select: The Flow Designer now supports multi-selection on the canvas and bulk actions for Start, Stop, Enable, Disable, Move, Change parent group, Copy/Paste, and Delete.
  
New ReadyFlows for this release:
* CDW Ingest
* CDP Kafka to Snowflake
* Slack to S3
* Updated Confluent Cloud to Snowflake using new Snowpipe processors

### CODE + COMMUNITY

Please join my meetup group NJ/NYC/Philly/Virtual. 

[http://www.meetup.com/futureofdata-princeton/](http://www.meetup.com/futureofdata-princeton/)

[https://www.meetup.com/futureofdata-newyork/](https://www.meetup.com/futureofdata-newyork/)

[https://www.meetup.com/futureofdata-philadelphia/](https://www.meetup.com/futureofdata-philadelphia/)


**This is Issue #91 **

You may notice a version jump, Linked in says we had 89 already, so I am assuming two other articles got assimilated.   I will go with this, since 90 is a better number.

[https://github.com/tspannhw/FLiPStackWeekly](https://github.com/tspannhw/FLiPStackWeekly)

[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)


### Courses

[https://www.cloudera.com/about/training/courses/apache-nifi-anti-patterns.html](https://www.cloudera.com/about/training/courses/apache-nifi-anti-patterns.html)

### Videos

[https://www.youtube.com/watch?v=H1SYOuLcUTI&ab_channel=Ververica](https://www.youtube.com/watch?v=H1SYOuLcUTI&ab_channel=Ververica)

[https://www.youtube.com/watch?app=desktop&v=8cZJ9CyLYyI](https://www.youtube.com/watch?app=desktop&v=8cZJ9CyLYyI)

### Conference Videos

Hail Hydrate! From Stream to Lake
[https://www.youtube.com/watch?v=IBpqa8re--o&ab_channel=PowerShell.org](https://www.youtube.com/watch?v=IBpqa8re--o&ab_channel=PowerShell.org)

### Articles

[https://medium.com/@tspann/ingesting-events-into-dockerized-ibm-db2-jdbc-with-apache-nifi-f0ca452d1351](https://medium.com/@tspann/ingesting-events-into-dockerized-ibm-db2-jdbc-with-apache-nifi-f0ca452d1351)

[https://a16z.com/2023/06/20/emerging-architectures-for-llm-applications/](https://a16z.com/2023/06/20/emerging-architectures-for-llm-applications/)

[https://dzone.com/articles/apache-nifi-10-cheatsheet](https://dzone.com/articles/apache-nifi-10-cheatsheet)

[https://www.linkedin.com/posts/excalidraw_re-keying-a-kafka-topic-activity-7077942003837100033-KfnM/](https://www.linkedin.com/posts/excalidraw_re-keying-a-kafka-topic-activity-7077942003837100033-KfnM/)

[https://medium.com/@tspann/functions-anywhere-faas-ee92ecedb248](https://medium.com/@tspann/functions-anywhere-faas-ee92ecedb248)



### Events

June 26-28, 2023:  NLIT Summit.  Milwaukee.  
[https://www.fbcinc.com/e/nlit/default.aspx](https://www.fbcinc.com/e/nlit/default.aspx)

June 28, 2023:  NiFi Meetup.   Milwaukee and Hybrid.
[https://www.meetup.com/futureofdata-princeton/events/292976004/](https://www.meetup.com/futureofdata-princeton/events/292976004/)

![meetup](https://raw.githubusercontent.com/tspannhw/FLiPStackWeekly/main/images/junemeetup.jpg)

July 19, 2023:   2-Hours to Data Innovation:   Data Flow
[https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html](https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html)

October 18, 2023:  2-Hours to Data Innovation:   Data Flow
[https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html](https://www.cloudera.com/about/events/hands-on-lab-series-2-hours-to-data-innovation.html)

Cloudera Events
[https://www.cloudera.com/about/events.html](https://www.cloudera.com/about/events.html)

More Events:
[https://www.linkedin.com/pulse/schedule-2023-tim-spann-/](https://www.linkedin.com/pulse/schedule-2023-tim-spann-/)



### Code

[https://github.com/polyzos/stream-processing-with-apache-flink](https://github.com/polyzos/stream-processing-with-apache-flink)

### NiFi Code


### Tools

* [https://devpod.sh/](https://devpod.sh/)
* [https://github.com/owenthereal/ccat](https://github.com/owenthereal/ccat)
* [https://github.com/SkalskiP/top-cvpr-2023-papers](https://github.com/SkalskiP/top-cvpr-2023-papers)
* [https://github.com/vercel-labs/ai](https://github.com/vercel-labs/ai)
* [https://github.com/arwes/arwes](https://github.com/arwes/arwes)
* [https://linearmouse.app/](https://linearmouse.app/)
* [https://github.com/axllent/mailpit](https://github.com/axllent/mailpit)
* [https://index.quantumstat.com/](https://index.quantumstat.com/)
* [https://www.edx.org/course/introduction-computer-science-harvardx-cs50x](https://www.edx.org/course/introduction-computer-science-harvardx-cs50x)
* [https://app.revolt.chat/login](https://app.revolt.chat/login)
* [https://github.com/binpash/try](https://github.com/binpash/try)
* https://paimon.apache.org/docs/master/engines/flink/
* https://github.com/Kanaries/pygwalker

&copy; 2020-2023 Tim Spann