|
--- |
|
license: cc-by-nc-sa-4.0 |
|
datasets: |
|
- roneneldan/TinyStories |
|
--- |
|
This is a character (english a-z 0-9 and so on) trained model following Andrej karpathy's llama.c project https://github.com/karpathy/llama2.c on both TinyStories and my own internal similar dataset I made. |
|
|
|
https://wandb.ai/corianas/llamac/reports/Microllama-300k-step--Vmlldzo3NDQxNDU5 |
|
|
|
for it to see/output Uppercase letters this model uses a Shift-Key modifier before the letter to become uppercase, and has never been trained on actual uppercase letters. |
|
|
|
This modifier is ↨ and here are the functions I use to convert from straight text to the modified format and back. |
|
``` |
|
def add_caseifer(text): |
|
# Using list comprehension for more efficient concatenation |
|
return ''.join(['↨' + char.lower() if char.isupper() else char for char in text |
|
|
|
def remove_caseifer(text): |
|
new_text = "" |
|
i = 0 |
|
while i < len(text): |
|
if text[i] == "↨": |
|
if i+1 < len(text): |
|
new_text += text[i+1].upper() |
|
i += 1 |
|
else: |
|
pass # skip this index |
|
else: |
|
new_text += text[i] |
|
i += 1 |
|
return new_text |
|
``` |
|
|
|
As such for test strings to use in chat try using somthing like: |
|
``` |
|
↨hello, my name is ↨clara and ↨i like |
|
``` |
