alfraser commited on
Commit
1e895ae
β€’
1 Parent(s): a377dbd

Updated formatting of file layout

Browse files
Files changed (1) hide show
  1. README.md +20 -20
README.md CHANGED
@@ -16,33 +16,33 @@ This project is a demonstration playground for the LLM-enabled architectures bui
16
 
17
  # File Structure
18
 
19
- ```
20
  llm-arch
21
  β”œβ”€β”€ config
22
- β”‚ β”œβ”€β”€ architectures.json (configuration for the architectures under test and displayed in the UI)
23
  β”œβ”€β”€ data
24
- β”‚ β”œβ”€β”€ fine_tuning (data and scripts related to fine-tuning LLMs)
25
- β”‚ β”œβ”€β”€ json (raw json files containing the synthetic private data built for the project)
26
  β”‚ β”œβ”€β”€ sqlite
27
- β”‚ β”‚ β”œβ”€β”€ 01_all_products_dataset.db (sqlite db containing all products generated)
28
- β”‚ β”‚ β”œβ”€β”€ 02_baseline_dataset.db (sqlite db containing the subset of data selected to be the baseline)
29
- β”‚ β”‚ β”œβ”€β”€ test_records.db (sqlite database containing the peristed test results)
30
- β”‚ β”œβ”€β”€ vector_stores
31
  β”œβ”€β”€ img
32
  β”œβ”€β”€ pages
33
  β”œβ”€β”€ src
34
- β”‚ β”œβ”€β”€ data_synthesis
35
- β”‚ β”œβ”€β”€ training
36
- β”‚ β”œβ”€β”€ architectures.py (the core architecture pipeline code including components, and trace)
37
- β”‚ β”œβ”€β”€ common.py (utilities for common functions, e.g. security token access, data type manipulations)
38
- β”‚ β”œβ”€β”€ datatypes.py (object oriented representation of the test data and single point for runtime access of the product DB)
39
- β”‚ β”œβ”€β”€ st_helpers.py (helpers specific to streamlit)
40
- β”‚ β”œβ”€β”€ testing.py (functionality relating to running, recording and reporting on batches of tests)
41
- β”œβ”€β”€ Home.py (main entry point for streamlit - first page in the streamlit app)
42
- β”œβ”€β”€ local_env.yml (conda environment for running project locally)
43
- β”œβ”€β”€ README.md (readme - this file)
44
- β”œβ”€β”€ requirements.txt (requirements file for additional requirements in the HF spaces environment - do not use for local running of the project)
45
- ```
46
 
47
 
48
  # Demonstration environment
 
16
 
17
  # File Structure
18
 
19
+ <pre>
20
  llm-arch
21
  β”œβ”€β”€ config
22
+ β”‚ β”œβ”€β”€ architectures.json <i>(configuration for the architectures under test and displayed in the UI)</i>
23
  β”œβ”€β”€ data
24
+ β”‚ β”œβ”€β”€ fine_tuning <i>(data and scripts related to fine-tuning LLMs)</i>
25
+ β”‚ β”œβ”€β”€ json <i>(raw json files containing the synthetic private data built for the project)</i>
26
  β”‚ β”œβ”€β”€ sqlite
27
+ β”‚ β”‚ β”œβ”€β”€ 01_all_products_dataset.db <i>(sqlite db containing all products generated)</i>
28
+ β”‚ β”‚ β”œβ”€β”€ 02_baseline_dataset.db <i>(sqlite db containing the subset of data selected to be the baseline)</i>
29
+ β”‚ β”‚ β”œβ”€β”€ test_records.db <i>(sqlite database containing the peristed test results)</i>
30
+ β”‚ β”œβ”€β”€ vector_stores <i>(chromadb files containing the document embeddings for the RAG architectures)</i>
31
  β”œβ”€β”€ img
32
  β”œβ”€β”€ pages
33
  β”œβ”€β”€ src
34
+ β”‚ β”œβ”€β”€ data_synthesis <i>(python code related to generating, selecting and loading the private dataset used for the project)</i>
35
+ β”‚ β”œβ”€β”€ training <i>(python code related to training the architectures - not used at runtime)</i>
36
+ β”‚ β”œβ”€β”€ architectures.py <i>(the core architecture pipeline code including components, and trace)</i>
37
+ β”‚ β”œβ”€β”€ common.py <i>(utilities for common functions, e.g. security token access, data type manipulations)</i>
38
+ β”‚ β”œβ”€β”€ datatypes.py <i>(object oriented representation of the test data and single point for runtime access of the product DB)</i>
39
+ β”‚ β”œβ”€β”€ st_helpers.py <i>(helpers specific to streamlit)</i>
40
+ β”‚ β”œβ”€β”€ testing.py <i>(functionality relating to running, recording and reporting on batches of tests)</i>
41
+ β”œβ”€β”€ Home.py <i>(main entry point for streamlit - first page in the streamlit app)</i>
42
+ β”œβ”€β”€ local_env.yml <i>(conda environment for running project locally)</i>
43
+ β”œβ”€β”€ README.md <i>(readme - this file)</i>
44
+ β”œβ”€β”€ requirements.txt <i>(requirements file for additional requirements in the HF spaces environment - do not use for local running of the project)</i>
45
+ </pre>
46
 
47
 
48
  # Demonstration environment