Open Source Social Applications with Apache Streams - Steve Blackmon
Channel: The ASF
Date: 2021-10-10

Thank you to all of of our ApacheCon@Home 2021 sponsors, including:

STRATEGIC
---------------
Google

PLATINUM
--------------
Apple
Huawei
Instaclustr
Tencent Cloud

GOLD
-----------
Aiven OY
AWS
Baidu
Cerner
Didi Chuxing
Dremio
Fiter
Gradle
Red Hat
Replicated Open Source Social Applications with Apache Streams - Steve Blackmon
A presentation from ApacheCon@Home 2021
https://apachecon.com/acah2021

Apache Streams unifies a diverse world of digital profiles and online activities into common formats and vocabularies, and makes these datasets accessible across a variety of databases, devices, and platforms for streaming, browsing, search, sharing, and analytics use-cases.

Apache Streams contains JRE-based modules that developers can use to easily integrate with online data sources and build polyglot indexes of activities, entities, and relationships - all based on public standards such as Activity Streams, or other published organizational standards.

Apache Streams makes it simple to load your data from social networks and similar sources, using API connections or full-archive data portability downloads, into a local database you can build applications on top of.

In this talk, I will give a primer on Apache Streams architecture and capabilities, as well as a demo of an application I built using my social data: Probot.

Profile Bot (aka probot) is an open-source software package you can run to manage your social media accounts programatically, as well as deep-dive into your social network data.

Once your data is loaded, you can browse, filter, search, and sort lists of your friends, followers, posts, shares, direct messages, etc… from the built-in browser, and perform mass actions. For example, delete all tweets where you mentioned a particular hashtag, for reasons.

Probot can also enrich your social data by running it through Apache Streams Processor modules, which can append attributes from open-source libraries and third-party APIs.

Probot runs on a small collection of docker containers (all OSS). All of the data can be queried via SQL or the embedded database http api for external integrations.

Probot is currently a single-user application, though with more engineering could turn it into a hosted SaaS application whose users would not need to create their own twitter application or interact with anything aside from a web browser.