ibrahimmkhalid commited on
Commit
3209fc4
·
1 Parent(s): df0e34d

update readme

Browse files
Files changed (1) hide show
  1. README.md +13 -9
README.md CHANGED
@@ -10,28 +10,32 @@ pinned: false
10
  ---
11
 
12
  # LLM From Scratch
 
13
  _Ibrahim Khalid_
14
 
15
- The hosted project is available on [HuggingFace](https://huggingface.co/spaces/ibrahimmkhalid/llm-from-scratch)
16
 
17
  The purpose of this project is to build a simple large language model from scratch.
18
 
19
-
20
  This repo is following the guide from https://www.youtube.com/watch?v=UU1WVnMk4E8
21
 
22
  In this repo:
23
- - ./shakespeare.txt - This is a sample text used for training a smaller scale model
24
- - ./bigram_testing.sync.ipynb - This notebook is where I test a basic BiGram model
25
- - ./gpt_shakespeare.sync.ipynb - Notebook implementing simple GPT model using entire works of shakespeare
26
- - ./gpt_openwebtext.sync.ipynb - Notebook implementing GPT model based on the [OpenWebText Corpus](https://skylion007.github.io/OpenWebTextCorpus/)
27
 
 
 
 
 
 
28
 
29
  ### Prepare environment
 
30
  ```
31
- pip install -r ./requirements-base.txt
32
- pip install -r ./requirements-pytorch.txt
33
  ```
 
34
  ---
35
- [On GitHub](https://github.com/ibrahimmkhalid/llm-from-scratch)
 
36
 
37
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
10
  ---
11
 
12
  # LLM From Scratch
13
+
14
  _Ibrahim Khalid_
15
 
16
+ The hosted project is available on [HuggingFace](https://huggingface.co/spaces/ibrahimmkhalid/llm-from-scratch)
17
 
18
  The purpose of this project is to build a simple large language model from scratch.
19
 
 
20
  This repo is following the guide from https://www.youtube.com/watch?v=UU1WVnMk4E8
21
 
22
  In this repo:
 
 
 
 
23
 
24
+ - ./shakespeare.txt - This is a sample text used for training a smaller scale model
25
+ - ./bigram/bigram_testing.sync.ipynb - This notebook is where I test a basic BiGram model
26
+ - ./bigram/bigram_testing.sync.py - Python script for BiGram testing
27
+ - ./simple_gpt/gpt_shakespeare.sync.ipynb - Notebook implementing simple GPT model using entire works of shakespeare
28
+ - ./simple_gpt/gpt_shakespeare.sync.py - Python script for GPT shakespeare model
29
 
30
  ### Prepare environment
31
+
32
  ```
33
+ pip install -r ./pre-requirements.txt
34
+ pip install -r ./requirements.txt
35
  ```
36
+
37
  ---
38
+
39
+ [On GitHub](https://github.com/ibrahimmkhalid/llm-from-scratch)
40
 
41
  Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference