About.md.md

This project builds a gpt-like bot that carries out conversation but is run locally.

The project is in two parts:
    - 1. Chainlit powered
    - 2. Streamlit powered

1. Streamlit powered

Interface

- The interface is built with streamlit

How to

- The model used is the gpt4all-j model with a size of over 3Gig.
- The app runs locally and can be veiwed in any browser at the specified port after running the streamlit app. **streamlit run streamlit_app.py** 
- A GPU powered machine is required to make the project runs faster. 

2. Chainlit powered

Interface

- The interface is that of the chainlit default interface

How to

- 2 different models were downoaded for this.
- Various models are available depending on the use case.
    - the downloaded ones are 
        - nous-hermes
        - the falcon
- both models over 3 gig
- The app runs locally and can be veiwed in any browser at the specified port after running the chainlit app. **chainlit run chainlit_app.py** 
- A GPU powered machine is required to make the project runs faster.


- All models are downloaded as a .bin file and are in the models folder which is added to the gitignore file. cos of the size.