Year and Decade End Report : 201*
Tags: 2010, 2019, 2020, apacheflink
Published: 2020-01-05 22:58:09

---
title: Year and Decade End Report : 201*
published: true
date: 2020-01-02 23:16:00 UTC
tags: 2010,2019,2020,apache-flink
canonical_url: 
---

## A Year in Big Data 2019

### For DZone Articles See Here:   [https://www.linkedin.com/pulse/my-top-articles-2019-timothy-spann/](https://www.linkedin.com/pulse/my-top-articles-2019-timothy-spann/)

It was a great year talking with the tech people of the Princeton area.  
  

**Blockchain**

[https://www.meetup.com/futureofdata-princeton/events/255404291/](https://www.meetup.com/futureofdata-princeton/events/255404291/)

  
**Deep Learning**

[https://www.meetup.com/futureofdata-princeton/events/258560318/](https://www.meetup.com/futureofdata-princeton/events/258560318/)

  

**Edge2AI**

[https://www.slideshare.net/bunkertor/cdf-edge-to-ai-with-cem-april-9-2019-princeton-fod-meetup ](https://www.slideshare.net/bunkertor/cdf-edge-to-ai-with-cem-april-9-2019-princeton-fod-meetup%C2%A0)  
[https://www.meetup.com/futureofdata-princeton/events/258600690/](https://www.meetup.com/futureofdata-princeton/events/258600690/)

  
**Edge2AI in Barcelona**  
[https://www.meetup.com/futureofdata-barcelona/events/259345951/](https://www.meetup.com/futureofdata-barcelona/events/259345951/)  
  

**Enterprise IoT**

[https://www.meetup.com/futureofdata-princeton/events/263872145](https://www.meetup.com/futureofdata-princeton/events/263872145)  
  
**HBase in CDP, FLaNK Stack and NiFi 1.10**  
[https://www.meetup.com/futureofdata-princeton/events/266496424/](https://www.meetup.com/futureofdata-princeton/events/266496424/)  
  

  

At other events, I got to join some amazing colleagues spreading the word about cool open source technology.

  

[https://www.cloudera.com/about/events/edge-to-ai-city-tour/new-york.html](https://www.cloudera.com/about/events/edge-to-ai-city-tour/new-york.html)

  

The Cloudera Forum for CDP in  MINNEAPOLIS.   I got to help out on the amazing launch of Data in Motion on Cloudera.  

  

[https://www.cloudera.com/content/dam/www/marketing/resources/webinars/data\_in\_motion\_tech\_launch\_showcase.png.landing.html](https://www.cloudera.com/content/dam/www/marketing/resources/webinars/data_in_motion_tech_launch_showcase.png.landing.html)

  

I got to lead all-day workshops in NYC, Boston and Washington DC.   I also got to talk about and do demos on NiFi and Phoenix for Cloudera Now online and some followup webinars.

  
I got to speak at a few awesome conferences this year.  
  
**Dataworks Summit Barcelona** ([https://www.slideshare.net/bunkertor/the-edge-to-ai-deep-dive-barcelona-meetup-march-2019](https://www.slideshare.net/bunkertor/the-edge-to-ai-deep-dive-barcelona-meetup-march-2019)) [https://www.datainmotion.dev/2019/03/barcelona-dataworks-summit-march-2019.html](https://www.datainmotion.dev/2019/03/barcelona-dataworks-summit-march-2019.html)  
  
 ![](https://lh6.googleusercontent.com/OOnWqwqLq4or09cYmeLu1PEyslty1xYYaYRTJhSaWp6XX17OkvSfGr4dVLvVyF27UtAoJHEUy9_VIAQ5KppnS2K2lY_EJwb9tm6H-LBxNdNGLPn7iB0MznnynwGoQmfI-28r7Pj2)  
  
**NoSQL Day DC** ([https://www.datainmotion.dev/2019/05/dataworks-summit-dc-2019-report.html](https://www.datainmotion.dev/2019/05/dataworks-summit-dc-2019-report.html)) See my joint talk on Phoenix and NiFi.  
  
 ![](https://1.bp.blogspot.com/-16xbBH9HDSM/XOgH_9yL8zI/AAAAAAAAXlo/P_72YBWnyZcKOMqqMBArET-ybMcJQielwCLcBGAs/s640/20190521_152122.jpg)  
  
**Dataworks Summit DC** ([https://dzone.com/articles/dataworks-summit-and-nosql-day-review-2019-washing](https://dzone.com/articles/dataworks-summit-and-nosql-day-review-2019-washing)) See my talks on NiFi, Blockchain and Deep Learning.  
  
 ![](https://1.bp.blogspot.com/-n7XoJAyVkzk/XOgIDLhrvoI/AAAAAAAAXmQ/gC_xbDUpKcIbfH7yEDCarIcNhVcUc7vdgCLcBGAs/s640/edge2ai.jpg)  
  
**Strata NYC** ([https://github.com/tspannhw/StrataNYC2019](https://github.com/tspannhw/StrataNYC2019)) . I helped with some hands-on training sessions on Data in Motion.  
  
 ![](https://lh3.googleusercontent.com/PXSG06_Co403mbFYfeSL5HotsxBCjA8Klsd22R9itdhdG8y5Ytnc7CJFYcLJWjPUs08dk1Hg2tmzkvTGdPN6YKvt8Z3S38mvr_CI9go694jUWCGPi9v62ldBieWvNFTjiLJAladnBzg)  
  
**Nethope Conference Puerto Rico**  
([https://nethopeglobalsummit2019.pathable.co/meetings/rmZ5yXXoJo4EfcaY7](https://nethopeglobalsummit2019.pathable.co/meetings/rmZ5yXXoJo4EfcaY7?es_p=9902233#/?sortByFields%5B0%5D=isPinned&sortByFields%5B1%5D=lastActivityAt&sortByOrders%5B0%5D=-1&sortByOrders%5B1%5D=-1))  
  

[![](https://1.bp.blogspot.com/-ejN1whPfgyU/Xg53pe6-YQI/AAAAAAAAZHA/oscb-gYYFF0TYwuDLzBdh5SSVVEY8ml2wCLcBGAsYHQ/s640/bigideasnethope.png)](https://1.bp.blogspot.com/-ejN1whPfgyU/Xg53pe6-YQI/AAAAAAAAZHA/oscb-gYYFF0TYwuDLzBdh5SSVVEY8ml2wCLcBGAsYHQ/s1600/bigideasnethope.png)
  
  

I wrote a few articles this year:

- [https://www.datainmotion.dev/2019/12/iot-series-minifi-agent-on-raspberry-pi.html](https://dev.to/tspannhw/iot-series-minifi-agent-on-raspberry-pi-4-with-enviro-hat-for-environmental-monitoring-and-analytics-l8d)
- [https://www.datainmotion.dev/2019/12/easy-deep-learning-in-apache-nifi-with.html](https://dev.to/tspannhw/easy-deep-learning-in-apache-nifi-with-djl-2d79)
- [https://www.datainmotion.dev/2019/12/princeton-new-jersey-usa-meetup-10.html](https://dev.to/tspannhw/princeton-new-jersey-usa-meetup-10-december-2019-hbase-flink-nifi-1-10-minifi-mxnet-kafka-kudu-2cl8)
- [https://www.datainmotion.dev/2019/12/hbase-20-on-cdp-on-aws.html](https://dev.to/tspannhw/hbase-2-0-on-cdp-on-aws-1ahj)
- [https://www.datainmotion.dev/2019/11/introducing-mm-flank-apache-flink-stack.html](https://dev.to/tspannhw/introducing-mm-flank-an-apache-flink-stack-for-rapid-streaming-development-from-edge-2-ai-5c12)
- [https://www.datainmotion.dev/2019/11/learning-apache-flink-19.html](https://dev.to/tspannhw/learning-apache-flink-1-9-133n)
- [https://www.datainmotion.dev/2019/11/nifi-toolkit-cli-for-nifi-110.html](https://dev.to/tspannhw/nifi-toolkit-cli-for-nifi-1-10-213h)
- [https://www.datainmotion.dev/2019/11/nifi-110-postslack-easy-image-upload.html](https://dev.to/tspannhw/nifi-1-10-postslack-easy-image-upload-22mh)
- [https://www.datainmotion.dev/2019/11/exploring-apache-nifi-110-parameters.html](https://dev.to/tspannhw/exploring-apache-nifi-1-10-parameters-and-stateless-engine-44n4)
- [https://www.datainmotion.dev/2019/11/learning-flink-and-analyzing-flink.html](https://dev.to/tspannhw/learning-flink-and-analyzing-flink-metrics-via-rest-api-4mka)
- [https://www.datainmotion.dev/2019/11/running-demo-apache-flink-application.html](https://dev.to/tspannhw/running-a-demo-apache-flink-application-with-apache-nifi-and-apache-kafka-on-cdh-6-3-100e)
- [https://www.datainmotion.dev/2019/10/apache-nifi-load-balancing-via-load.html](https://dev.to/tspannhw/apache-nifi-load-balancing-via-load-balanced-connections-593m)
- [https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache\_15.html](https://dev.to/tspannhw/migrating-apache-flume-flows-to-apache-nifi-any-relational-database-to-from-anywhere-45d1)
- [https://www.datainmotion.dev/2019/10/using-grovepi-with-raspberry-pi-and.html](https://dev.to/tspannhw/using-grovepi-with-raspberry-pi-and-minifi-agents-for-data-ingest-to-parquet-kudu-orc-kafka-hive-and-impala-2h9k)
- [https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache\_9.html](https://dev.to/tspannhw/migrating-apache-flume-flows-to-apache-nifi-kafka-source-to-http-rest-sink-and-http-rest-source-to-kafka-sink-1257)
- [https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache\_35.html](https://dev.to/tspannhw/migrating-apache-flume-flows-to-apache-nifi-syslog-to-kafka-3a1k)
- [https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache\_8.html](https://dev.to/tspannhw/migrating-apache-flume-flows-to-apache-nifi-twitter-source-to-kafka-sink-31d1)
- [https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache\_7.html](https://dev.to/tspannhw/migrating-apache-flume-flows-to-apache-nifi-kafka-source-to-apache-parquet-on-hdfs-1npb)
- [https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache.html](https://dev.to/tspannhw/migrating-apache-flume-flows-to-apache-nifi-kafka-source-to-hdfs-kudu-file-hive-55gj)
- [https://www.datainmotion.dev/2019/10/tracking-air-quality-with-apache-nifi.html](https://dev.to/tspannhw/tracking-air-quality-with-apache-nifi-cloudera-data-science-workbench-pyspark-and-parquet-28c)
- [https://www.datainmotion.dev/2019/10/monitoring-cloudera-edge-flow-manager.html](https://dev.to/tspannhw/monitoring-cloudera-edge-flow-manager-and-cloudera-streams-messaging-manager-with-apache-nifi-387k)
- [https://www.datainmotion.dev/2019/09/powering-edge-ai-for-sensor-reading.html](https://dev.to/tspannhw/powering-edge-ai-for-sensor-reading-with-rpi-and-breakout-garden-efm-nifi-minifi-agents-gkj)
- [https://www.datainmotion.dev/2019/09/backup-and-restore-nifi-registry.html](https://dev.to/tspannhw/backup-and-restore-nifi-registry-templates-14m)
- [https://www.datainmotion.dev/2019/08/google-coral-tpu-with-edge-devices-and.html](https://dev.to/tspannhw/google-coral-tpu-with-edge-devices-and-minifi-e6n)
- [https://www.datainmotion.dev/2019/08/updating-machine-learning-models-at.html](https://dev.to/tspannhw/updating-machine-learning-models-at-the-edge-with-apache-nifi-and-minifi-3ama)
- [https://www.datainmotion.dev/2019/08/generating-json-data-in-apache-nifi.html](https://dev.to/tspannhw/generating-json-data-in-apache-nifi-4apo)
- [https://www.datainmotion.dev/2019/08/using-cloudera-streams-messaging.html](https://dev.to/tspannhw/using-cloudera-streams-messaging-manager-for-apache-kafka-monitoring-management-analytics-and-crud-41fb)
- [https://www.datainmotion.dev/2019/08/gtfs-real-time-streaming-with-apache.html](https://www.datainmotion.dev/2019/08/gtfs-real-time-streaming-with-apache.html)
- [https://www.datainmotion.dev/2019/08/efm-series-using-minifi-agents-on.html](https://www.datainmotion.dev/2019/08/efm-series-using-minifi-agents-on.html)
- [https://www.datainmotion.dev/2019/08/migrating-apache-flume-flows-to-apache.html](https://www.datainmotion.dev/2019/08/migrating-apache-flume-flows-to-apache.html)
- [https://www.datainmotion.dev/2019/08/rapid-iot-development-with-cloudera.html](https://www.datainmotion.dev/2019/08/rapid-iot-development-with-cloudera.html)
- [https://www.datainmotion.dev/2019/08/creating-apache-kafka-topics.html](https://www.datainmotion.dev/2019/08/creating-apache-kafka-topics.html)
- [https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html](https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html)
- [https://www.datainmotion.dev/2019/07/edge-processing-with-jetson-nano-part-2.html](https://www.datainmotion.dev/2019/07/edge-processing-with-jetson-nano-part-2.html)
- [https://www.datainmotion.dev/2019/07/edge-data-processing-with-jetson-nano.html](https://www.datainmotion.dev/2019/07/edge-data-processing-with-jetson-nano.html)
- [https://www.datainmotion.dev/2019/07/philadelphia-open-crime-data-on-phoenix.html](https://www.datainmotion.dev/2019/07/philadelphia-open-crime-data-on-phoenix.html)
- [https://www.datainmotion.dev/2019/07/powering-edge-ai-with-powerful-jetson.html](https://www.datainmotion.dev/2019/07/powering-edge-ai-with-powerful-jetson.html)
- [https://www.datainmotion.dev/2019/06/performance-testing-apache-nifi-part-1.html](https://www.datainmotion.dev/2019/06/performance-testing-apache-nifi-part-1.html)
- [https://www.datainmotion.dev/2019/05/dataworks-summit-dc-2019-report.html](https://www.datainmotion.dev/2019/05/dataworks-summit-dc-2019-report.html)
- [https://www.datainmotion.dev/2019/05/reading-opendata-json-and-storing-into.html](https://www.datainmotion.dev/2019/05/reading-opendata-json-and-storing-into.html)
- [https://www.datainmotion.dev/2019/05/cloudera-edge-management-introduction.html](https://www.datainmotion.dev/2019/05/cloudera-edge-management-introduction.html)
- [https://www.datainmotion.dev/2019/04/streams-messaging-manager-smm-rest-api.html](https://www.datainmotion.dev/2019/04/streams-messaging-manager-smm-rest-api.html)
- [https://www.datainmotion.dev/2019/04/energy-monitoring-via-apache-nifi.html](https://www.datainmotion.dev/2019/04/energy-monitoring-via-apache-nifi.html)
- [https://www.datainmotion.dev/2019/04/iot-edge-use-cases-with-apache-kafka.html](https://www.datainmotion.dev/2019/04/iot-edge-use-cases-with-apache-kafka.html)
- 
- [https://dzone.com/articles/combining-djlai-with-apache-nifi-for-deep-learning](https://dzone.com/articles/combining-djlai-with-apache-nifi-for-deep-learning)
- [https://dzone.com/articles/modern-apache-nifi-load-balancing](https://dzone.com/articles/modern-apache-nifi-load-balancing)
- [https://dzone.com/articles/exploring-apache-nifi-110-parameters-and-stateless](https://dzone.com/articles/exploring-apache-nifi-110-parameters-and-stateless)
- [https://dzone.com/articles/migrating-apache-flume-flows-to-apache-nifi-kafka](https://dzone.com/articles/migrating-apache-flume-flows-to-apache-nifi-kafka)
- [https://dzone.com/articles/real-time-transit-feed-data-processing](https://dzone.com/articles/real-time-transit-feed-data-processing)
- [https://dzone.com/articles/efm-series-using-minifi-agents-on-raspberry-pi-4-w](https://dzone.com/articles/efm-series-using-minifi-agents-on-raspberry-pi-4-w)
- [https://dzone.com/articles/creating-apache-kafka-topics-dynamically-as-part-o](https://dzone.com/articles/creating-apache-kafka-topics-dynamically-as-part-o)
- [https://dzone.com/articles/edge-data-processing-with-jetson-nano](https://dzone.com/articles/edge-data-processing-with-jetson-nano)
- [https://dzone.com/articles/powering-edge-ai-with-the-powerful-jetson-nano](https://dzone.com/articles/powering-edge-ai-with-the-powerful-jetson-nano)
- [https://dzone.com/articles/dataworks-summit-and-nosql-day-review-2019-washing](https://dzone.com/articles/dataworks-summit-and-nosql-day-review-2019-washing)
- [https://dzone.com/articles/advanced-xml-processing-with-apache-nifi-191](https://dzone.com/articles/advanced-xml-processing-with-apache-nifi-191)
- [https://dzone.com/articles/iot-device-data-and-stream-processing](https://dzone.com/articles/iot-device-data-and-stream-processing)
- [https://dzone.com/articles/integration-of-apache-nifi-and-cloudera-data-scien](https://dzone.com/articles/integration-of-apache-nifi-and-cloudera-data-scien)
- [https://dzone.com/articles/reading-sudo-logs-with-apache-nifi](https://dzone.com/articles/reading-sudo-logs-with-apache-nifi)
- [https://dzone.com/articles/using-cloudera-data-science-workbench-with-apache](https://dzone.com/articles/using-cloudera-data-science-workbench-with-apache)
- [https://dzone.com/articles/sochain-bitcoin-dogecoin-and-litecoin-data-rest-ap](https://dzone.com/articles/sochain-bitcoin-dogecoin-and-litecoin-data-rest-ap)
- [https://dzone.com/articles/working-with-proximity-beacons](https://dzone.com/articles/working-with-proximity-beacons)
- [https://dzone.com/articles/sensors-utilizing-breakout-garden](https://dzone.com/articles/sensors-utilizing-breakout-garden)
[https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html](https://www.datainmotion.dev/2019/08/edge-processing-with-jetson-nano-part-3.html)- [https://community.cloudera.com/t5/Community-Articles/Exploring-Apache-NiFi-1-10-Parameters-and-Stateless-Engine/ta-p/283266](https://community.cloudera.com/t5/Community-Articles/Exploring-Apache-NiFi-1-10-Parameters-and-Stateless-Engine/ta-p/283266)
- [https://community.cloudera.com/t5/Community-Articles/Edge-Data-Processing-with-Jetson-Nano-Part-3-AI-Integration/ta-p/93642](https://community.cloudera.com/t5/Community-Articles/Edge-Data-Processing-with-Jetson-Nano-Part-3-AI-Integration/ta-p/93642)
- [https://community.cloudera.com/t5/Community-Articles/Migrating-Apache-Flume-Flows-to-Apache-NiFi-Kafka-Source-to/ta-p/278870](https://community.cloudera.com/t5/Community-Articles/Migrating-Apache-Flume-Flows-to-Apache-NiFi-Kafka-Source-to/ta-p/278870)
- [https://community.cloudera.com/t5/Community-Articles/Using-Raspberry-Pi-3B-with-Apache-NiFi-MiNiFi-and-Google/ta-p/249478](https://community.cloudera.com/t5/Community-Articles/Using-Raspberry-Pi-3B-with-Apache-NiFi-MiNiFi-and-Google/ta-p/249478)
- [https://dev.to/tspannhw/iot-series-minifi-agent-on-raspberry-pi-4-with-enviro-hat-for-environmental-monitoring-and-analytics-l8d](https://dev.to/tspannhw/iot-series-minifi-agent-on-raspberry-pi-4-with-enviro-hat-for-environmental-monitoring-and-analytics-l8d)
- [https://dev.to/tspannhw/easy-deep-learning-in-apache-nifi-with-djl-2d79](https://dev.to/tspannhw/easy-deep-learning-in-apache-nifi-with-djl-2d79)
  
  
Here are my slides from 2019:

  

- 
- [https://www.slideshare.net/bunkertor/tracking-crime-as-it-occurs-with-apache-phoenix-apache-hbase-and-apache-nifi](https://www.slideshare.net/bunkertor/tracking-crime-as-it-occurs-with-apache-phoenix-apache-hbase-and-apache-nifi)
- [https://www.slideshare.net/bunkertor/apache-deep-learning-202-washington-dc-dws-2019](https://www.slideshare.net/bunkertor/apache-deep-learning-202-washington-dc-dws-2019)
- [https://www.slideshare.net/MehulShah218/cold-supply-chain-logistics-using-sensors-apache-ni-fi-and-the-hyperledger-fabric-blockchain-platform](https://www.slideshare.net/MehulShah218/cold-supply-chain-logistics-using-sensors-apache-ni-fi-and-the-hyperledger-fabric-blockchain-platform)
- [https://www.slideshare.net/bunkertor/introduction-to-apache-nifi-dws19-dws-dc-2019](https://www.slideshare.net/bunkertor/introduction-to-apache-nifi-dws19-dws-dc-2019)
- [https://www.slideshare.net/bunkertor/edge-to-ai-analytics-from-edge-to-cloud-with-efficient-movement-of-machine-data-147411788](https://www.slideshare.net/bunkertor/edge-to-ai-analytics-from-edge-to-cloud-with-efficient-movement-of-machine-data-147411788)
- [https://www.slideshare.net/bunkertor/apache-deep-learning-202-washington-dc-dws-2019](https://www.slideshare.net/bunkertor/apache-deep-learning-202-washington-dc-dws-2019)
  
  

## A Decade End Wrap Up 2010-2019
Blockchain and Cryptocurrency blew up and then blew up.   There's a few solid use cases though and the similarities between early Hadoop and Blockchain are interesting.   You can't count this stuff out.  
  

## What's Coming in 2020
  

- Cloud Enterprise Data Platforms
- Hybrid Cloud
- Streaming with Flink, Kafka, NiFi
- AI at the Edge with Microcontrollers and Small Devices
- Voice Data In Queries
- Event Handler as a Service (Automatic Kafka Message Reading)
- More Powerful Parameter Based Modular Streaming 
- Cloud First For Big Data
- Log Handling Moves to MiNiFi
- Full AI At The Edge with Deployable Models
- More Powerful Edge TPU/GPU/VPU
- Kafka is everywhere
- Open Source UI Driven Event Engines
- FLaNK Stack gains popularity
  
  
**References** :  
  
  

- [https://www.oreilly.com/library/view/oreilly-strata-data/9781492050681/video327455.html](https://www.oreilly.com/library/view/oreilly-strata-data/9781492050681/video327455.html)
- [https://www.oreilly.com/library/view/oreilly-strata-data/9781492050681/video328109.html](https://www.oreilly.com/library/view/oreilly-strata-data/9781492050681/video328109.html)