### This project builds a gpt-like bot that carries out conversation but is run locally.
    The project is in two parts:
        - 1. Chainlit powered
        - 2. Streamlit powered

#### 1. Streamlit powered

##### Interface
    - The interface is built with streamlit
##### How to
    - The model used is the gpt4all-j model with a size of over 3Gig.
    - The app runs locally and can be veiwed in any browser at the specified port after running the streamlit app. **streamlit run streamlit_app.py** 
    - A GPU powered machine is required to make the project runs faster. 

#### 2. Chainlit powered

##### Interface
    - The interface is that of the chainlit default interface
##### How to
    - 2 different models were downoaded for this.
    - Various models are available depending on the use case.
        - the downloaded ones are 
            - nous-hermes
            - the falcon
    - both models over 3 gig
    - The app runs locally and can be veiwed in any browser at the specified port after running the chainlit app. **chainlit run chainlit_app.py** 
    - A GPU powered machine is required to make the project runs faster.


    - All models are downloaded as a .bin file and are in the models folder which is added to the gitignore file. cos of the size.