Project: Memphis (App Definition and Development / Streaming & Messaging)
File: README.md

<a href="">](https://memphis.dev)</a> <p align="center"> <a href="https://memphis.dev/discord"><img src="https://img.shields.io/discord/963333392844328961?color=6557ff&label=discord" alt="Discord"></a> <a href="https://github.com/memphisdev/memphis/issues?q=is%3Aissue+is%3Aclosed"><img src="https://img.shields.io/github/issues-closed/memphisdev/memphis?color=6557ff"></a> <img src="https://img.shields.io/npm/dw/memphis-dev?color=ffc633&label=installations"> <a href="https://github.com/memphisdev/memphis/blob/master/CODEOFCONDUCT.md"><img src="https://img.shields.io/badge/Code%20of%20Conduct-v1.0-ff69b4.svg?color=ffc633" alt="Code Of Conduct"></a> <img alt="GitHub release (latest by date)" src="https://img.shields.io/github/v/release/memphisdev/memphis?color=61dfc6"> <img src="https://img.shields.io/github/last-commit/memphisdev/memphis?color=61dfc6&label=last%20commit"> </p> <div align="center"> <h4> Is The First Data Streaming Platform Designed For Backend Developers<br> To Build Event-driven And Real-time Features Faster Than Ever.<br> <img width="177" alt="cloud_native 2 (5)" src="https://github.com/memphisdev/memphis/assets/107035359/a20ea11c-d509-42bb-a46c-e388c8424101"> </h4> </div> Before Memphis came along, handling ingestion and processing of events on a large scale took months to adopt and was a capability reserved for the top 20% of mega-companies. Now, Memphis opens the door for the other 80% to unleash their event and data streaming superpowers quickly, easily, and with great cost-effectiveness. | <br> ```shell helm repo add memphis https://k8s.memphis.dev/charts/ --force-update && \ helm install my-memphis memphis/memphis --create-namespace --namespace memphis ``` ```shell curl -s https://memphisdev.github.io/memphis-docker/docker-compose.yml -o docker-compose.yml && \ docker compose -f docker-compose.yml -p memphis up ``` <div align="center"> <img style="width: 50%" src="https://github.com/memphisdev/memphis/assets/70286779/38c7cee0-964e-40bd-ab3c-0ea5aeefc513" /> </div> Production-ready message broker in under 3 minutes<br> Easy-to-use UI, CLI, and SDKs<br> Data-level observability<br> Dead-Letter Queue with automatic message retransmit<br> Schemaverse - Embedded schema management for produced data (Protobuf/JSON/GraphQL/Avro)<br> Functions for real-time processing<br> Graph visualization<br> Storage tiering<br> SDKs: Node.JS, Go, Python, Typescript, NestJS, REST, .NET, Kotlin<br> Kubernetes-native<br> Community driven<br> <table> <tr> <th> <a href="https://docs.memphis.dev">End-to-end Observability</a> </th> <th> <a href="https://docs.memphis.dev">"Feel" your producers, consumers, and records</a> </th> </tr> <tr> <td width="50%"> <a href="https://docs.memphis.dev"> <img src="https://github.com/memphisdev/memphis/assets/70286779/5763319d-1c06-4478-b0ee-582f37acf2b8" /> </a> </td> <td width="50%"> <a href="https://docs.memphis.dev"> <img width="1512" alt="Screenshot 2023-09-29 at 10 17 01" src="https://github.com/memphisdev/memphis/assets/70286779/1fd5358d-adb8-4aa5-9b19-9640bdfd2417"> </a> </td> </tr> <tr> <th> <a href="https://docs.memphis.dev">Quickly analyze system health using a graph overview</a> </th> <th> <a href="https://docs.memphis.dev">Never lose a message with automatic dead-letter</a> </th> </tr> <tr> <td width="50%"> <a href="https://docs.memphis.dev"> <img src="https://github.com/memphisdev/memphis/assets/70286779/1be9768b-b658-4bb3-89bd-ee814a8813b9" /> </a> </td> <td width="50%"> <a href="https://docs.memphis.dev"> <img width="1512" alt="Screenshot 2023-09-29 at 10 17 12" src="https://github.com/memphisdev/memphis/assets/70286779/2d6638d8-d1f1-4aba-8e36-7b7a57e76f16"> </a> </td> </tr> <tr> <th> <a href="https://docs.memphis.dev/memphis/memphis-broker/concepts/storage-and-redundancy">Save up 96% storage costs with Storage tiering</a> </th> <th> <a href="https://docs.memphis.dev/memphis/memphis-schemaverse/schemaverse-schema-management">Increase data quality with schemas</a> </th> </tr> <tr> <td width="50%"> <a href="https://docs.memphis.dev"> <img width="1512" alt="Screenshot 2023-09-29 at 10 17 58" src="https://github.com/memphisdev/memphis/assets/70286779/beeaec9f-c8a5-4f6a-b520-a810eb68aa13"> </a> </td> <td width="50%"> <a href="https://docs.memphis.dev"> <img width="1512" alt="Screenshot 2023-09-29 at 10 16 40" src="https://github.com/memphisdev/memphis/assets/70286779/7c62977a-2d83-4c54-b233-084958be1411"> </a> </td> </tr> </table> <a href="https://docs.memphis.dev/memphis/memphis/architecture"> <p align="center"> <img height="500" alt="memphis.dev Architecture" src="https://user-images.githubusercontent.com/70286779/229371674-35a5e4cc-d3f5-413e-982d-d1081b18d82a.jpeg"> </p> </a> Feature | Go | Python | JS |

| Java | Rust | - | - | - | - | - | - Connection | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Disconnection | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Create a station | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Destroy a station | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Retention | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Retention values | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Storage types | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Create a new schema | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Enforce a schema Protobuf | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Enforce a schema Json | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :construction: (WIP) Enforce a schema GraphQL | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Enforce a schema Avro | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Detach a schema | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Produce | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Add headers | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Async produce | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Message ID | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | ? | :whitecheckmark: Destroy a producer | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | Partial | :whitecheckmark: Consume | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Context to message handler | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | Not Applicable Ack a message | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Nack a Message | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Send a message to dead-letter | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Get message time sent | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Fetch | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: Message delay | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Get Headers | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Get message sequence number | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Destroying a Consumer | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: Check if broker is connected | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: Consumer prefetch | :whitecheckmark: | :whitecheckmark: | :x: | :whitecheckmark: | :x: | :whitecheckmark: Schema deserialization | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :whitecheckmark: | :x: | :x: Async task management Real-time streaming pipelines Data ingestion Cloud Messaging Services (microservices, service mesh) Event/Data Streaming (observability, analytics, ML/AI) Queuing N:N communication patterns Ingest Grafana Loki logs at scale We welcome you to our discord server with your questions, doubts and feedback. <a href="https://memphis.dev/discord"><img src="https://amplication.com/images/discordbannerpurple.svg"/></a> If you see an error message or run into an issue, please . This effort is valued and it will help all Memphis{dev} users. If you have an idea, or you think that we're missing a capability that would make development easier and more robust, please . If an issuewith similar feature request already exists, don't forget to leave a "+1". If you add some more