AmelieSchreiber
commited on
Commit
•
a912e2f
1
Parent(s):
692f69c
Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ In this model, we wanted to see how the performance metrics were effected by ada
|
|
8 |
shown to be the most important hyperparameter for improvement in performance metrics by far, whereas hyperparameters such as rank and scaling
|
9 |
factor were shown to be negligible in importance, with lower rank being just as good as higher rank. So, we decided to test the difference between
|
10 |
simply using the query, key, and value weight matrix adapters to using adapters for all possible weight matrices. The comparison for the
|
11 |
-
first epoch can be seen below. Note the minor performance improvements for the model using every possible weight matrix.
|
12 |
|
13 |
### This model
|
14 |
|
|
|
8 |
shown to be the most important hyperparameter for improvement in performance metrics by far, whereas hyperparameters such as rank and scaling
|
9 |
factor were shown to be negligible in importance, with lower rank being just as good as higher rank. So, we decided to test the difference between
|
10 |
simply using the query, key, and value weight matrix adapters to using adapters for all possible weight matrices. The comparison for the
|
11 |
+
first epoch can be seen below. Note the minor performance improvements for the model using every possible weight matrix (this model).
|
12 |
|
13 |
### This model
|
14 |
|