Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,11 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
MiniSymp2 is A retrain of my MiniSymposium model attempt except with some more data and better practices.
|
| 6 |
+
|
| 7 |
+
- added EOS tokens where they belong
|
| 8 |
+
- made the prompt formats more diverse in the data so you could experiment / play with prompt format in context
|
| 9 |
+
- added some new examples
|
| 10 |
+
- measured loss curve to make sure I wasn't overfitting
|
| 11 |
+
- used 8-bit lora instead of 4-bit qlora
|