Create README.md

README.md

@@ -0,0 +1,18 @@
+This lora adapter is from "asprenger/bloom-6b4-clp-german-instruct-lora". Thanks for the adapter!
+
+I thought I was uploading the complete bloom-6b4-clp-german model with the adapter that I made to work but then after pushing the model I realized that it was only the adapter. Still exploring how this PEFT works with LoRA works :)
+
+strict requirments for peft
+
+`peft==0.2.0`
+
+requirment
+
+`pip install transformers accelerate bitsandbytes peft==0.2.0`
+
+latest peft has breaking changes with the bloom-6b4-clp-german and this lora adapter, and the only way to get them both work is (I think) is to train the base model or the adapter
+again (I am not sure yet).
+
+Reference:
+- https://github.com/linhduongtuan/BLOOM-LORA/issues/5
+- https://github.com/huggingface/peft/issues/276