p8hub 0.0.4
Private AI Hub - Host your own Generative AI Services
License: Apache License 2.0
Keywords: Platform,Local,Generative AI,GPT,LLM,Stable Diffusion,Docker

# Private AI Hub (P8Hub)

**"Host and use your own AI Services. Keep everything simple and private."**

In an era where AI is transforming every aspect of our lives, I recognized the need for a private and easy-to-use platform where individuals and small teams could host and utilize their own AI services. The inspiration for P8Hub came from the desire to make AI technologies accessible and private, democratizing them for all.

![P8Hub](https://raw.githubusercontent.com/vietanhdev/vietanhdev/main/p8hub/screenshot.png)

## Architecture

![Architecture](https://raw.githubusercontent.com/vietanhdev/vietanhdev/main/p8hub/p8hub-architecture.svg)

The architecture of P8Hub consists of two main components: a FastAPI backend and a Next.js frontend. The backend and frontend communicate with each other via REST API. For ease of deployment, I build frontend into static files and serve them from the backend. The interaction with Docker (running, stopping, and monitoring services) is done via [Python on Whales](https://pypi.org/project/python-on-whales/) package.

## Features

Some features are still in development. You can check the progress here.

- [x] Monitor hardware resources.
- [x] Service management (start, stop/delete).
- [x] Service logs viewer.
- [x] [OllamaLLM](https://github.com/ollama-webui/ollama-webui) - General chatbot service.
- [x] **Teachable AI** - Teach the computer to classify images - STEAM.
- [x] [docTR](https://github.com/mindee/doctr) - Document Text Recognition.
- [x] [Whishper](https://github.com/pluja/whishper/) - Text to speech service.
- [x] [TTS Generation](https://github.com/rsxdalv/tts-generation-webui) (GPU Only)
- [x] Docker extension.
- [ ] Image generation service.
- [ ] Add documentation.
- [ ] Add tests.
- [ ] App editor.

The applications were not selected carefully due to limited time. I think many more interesting AI applications can be integrated into P8Hub. If you have any suggestions, please [let me know](https://github.com/vietanhdev/p8hub/pulls) or create a pull request.

## I. Installation and Usage

### 1. Installation

- Python 3.9 or higher.
- Install **p8hub**:

```shell
pip install p8hub
```

### 2. Usage

- Run the app:

```shell
python -m p8hub.app
```

or just:

```shell
p8hub
```

- Go to <http://localhost:5678/> to see the user interface.

You can also run Private AI Hub publicly to your network or change the port with parameters. Example:

```shell
p8hub --host 0.0.0.0 --port 8080
```

### 3. Docker Extension (Experimental)

Docker Extension allows to extend the functionality of Docker Desktop. We've developed a Docker Extension for P8Hub. You can install it by running:

```shell
make install-extension
```

You should see the extension in Docker Desktop's UI.

![P8Hub Docker Extension](https://raw.githubusercontent.com/vietanhdev/vietanhdev/main/p8hub/p8hub-docker-extension-screenshot.png)

**Architecture:**

![P8Hub Docker Extension Architecture](https://raw.githubusercontent.com/vietanhdev/vietanhdev/main/p8hub/p8hub-docker-extension.svg)


## II. Development

### 1. Clone the source code

```shell
git clone https://github.com/vietanhdev/p8hub
cd p8hub
```

### 2. Run your backend

- Python 3.9 or higher.
- To install from source, from `p8hub` source code directory, run:

```shell
pip install -e .
```

- Run the app:

```shell
python -m p8hub.app
```

- Go to <http://localhost:5678/> to see the user interface.

### 2. Run your frontend

- Install the dependencies:

```shell
cd frontend
npm install
```

- Run the app:

```shell
npm run dev
```

- Go to <http://localhost:3000/> to see the user interface. Use this address to develop the frontend.

## References

- Next Template: [https://github.com/shadcn-ui/next-template](https://github.com/shadcn-ui/next-template).
- PAutoBot: [https://github.com/nrl-ai/pautobot](https://github.com/nrl-ai/pautobot).

![DockerML Hackathon 2023](https://raw.githubusercontent.com/vietanhdev/vietanhdev/main/p8hub/dockerml2023.jpeg)

This project was created for the [Docker AI/ML Hackathon 2023](https://docker.devpost.com/).