File size: 1,282 Bytes
d0f4923 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |
### This project builds a gpt-like bot that carries out conversation but is run locally.
The project is in two parts:
- 1. Chainlit powered
- 2. Streamlit powered
#### 1. Streamlit powered
##### Interface
- The interface is built with streamlit
##### How to
- The model used is the gpt4all-j model with a size of over 3Gig.
- The app runs locally and can be veiwed in any browser at the specified port after running the streamlit app. **streamlit run streamlit_app.py**
- A GPU powered machine is required to make the project runs faster.
#### 2. Chainlit powered
##### Interface
- The interface is that of the chainlit default interface
##### How to
- 2 different models were downoaded for this.
- Various models are available depending on the use case.
- the downloaded ones are
- nous-hermes
- the falcon
- both models over 3 gig
- The app runs locally and can be veiwed in any browser at the specified port after running the chainlit app. **chainlit run chainlit_app.py**
- A GPU powered machine is required to make the project runs faster.
- All models are downloaded as a .bin file and are in the models folder which is added to the gitignore file. cos of the size.
|