Spaces:
Runtime error
Runtime error
Tweaked the app main page name and added in the descriptive content.
Browse files
Home.py
CHANGED
@@ -4,13 +4,19 @@ from src.st_helpers import st_setup
|
|
4 |
if st_setup("LLM Architectures"):
|
5 |
st.write("""
|
6 |
# LLM Architecture Assessment
|
7 |
-
This
|
|
|
|
|
|
|
|
|
8 |
|
9 |
## Tools
|
10 |
-
This
|
11 |
|
12 |
-
- **LLM servers**: The structure of the project calls for each LLM being used to be run as a separate local service and accessed through http requests. This area allows users to see the models which are currently set up, start and stop the associated servers, and manually chat directly with the underlying models.
|
13 |
- **LLM architectures**: Around the LLM models are wrapped "architectures" which are the systems under test and being assessed. This area allows users to see those configurations and manually chat with the architecture, as opposed to directly with the model.
|
14 |
- **Data browser**: Underlying this architectural assessment is a synthetic "closed" data set, which has been generated offline to simulate a closed enterprise style dataset for testing purposes. This data browser element allows users to view that data directly.
|
15 |
- **Transaction logging**: As interactions are taking place with the architectures under test, the results are being logged for analysis. This area allows users to view those log records and see some simple results.
|
|
|
|
|
|
|
16 |
""")
|
|
|
4 |
if st_setup("LLM Architectures"):
|
5 |
st.write("""
|
6 |
# LLM Architecture Assessment
|
7 |
+
This project is an interactive version of the LLM Architecture Assessment project prepared by [Alisdair Fraser](http://www.linkedin.com/alisdairfraser) (alisdairfraser (at) gmail (dot) com), in submission for the final research project for the [Online MSc in Artificial Intelligence](https://info.online.bath.ac.uk/msai/) with the University of Bath.
|
8 |
+
|
9 |
+
The goal of the project is to do an assessment of the architectural patterns for deploying LLMs in conjunction with private data stores. The target audience is IT management, with a goal of providing key considerations for why one might choose a particular architecture or another.
|
10 |
+
|
11 |
+
All the source code for this application and the associated tooling and data can be found the [project GitHub repo on Hugging Face](https://huggingface.co/spaces/alfraser/llm-arch/tree/main).
|
12 |
|
13 |
## Tools
|
14 |
+
This web application serves as the management console to run different elements required to test the architectures. Specifically:
|
15 |
|
|
|
16 |
- **LLM architectures**: Around the LLM models are wrapped "architectures" which are the systems under test and being assessed. This area allows users to see those configurations and manually chat with the architecture, as opposed to directly with the model.
|
17 |
- **Data browser**: Underlying this architectural assessment is a synthetic "closed" data set, which has been generated offline to simulate a closed enterprise style dataset for testing purposes. This data browser element allows users to view that data directly.
|
18 |
- **Transaction logging**: As interactions are taking place with the architectures under test, the results are being logged for analysis. This area allows users to view those log records and see some simple results.
|
19 |
+
|
20 |
+
## Credits
|
21 |
+
- This project predominantly uses [LLama 2](https://ai.meta.com/llama/) and derivative models for language inference. Models are made available under the [Meta Llama license](https://ai.meta.com/llama/license/).
|
22 |
""")
|