--- library_name: peft base_model: unsloth/codellama-34b-bnb-4bit --- # Model Card for Model ID Unsloth base model Code Llama2 34b (https://huggingface.co/unsloth/codellama-34b-bnb-4bit) trained on Alpaca Dataset. This is a repository for another 34B instruct-tuned version. ``` Tue Apr 30 18:21:29 2024 +---------------------------------------------------------------------------------------+ | NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 | |-----------------------------------------+----------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+======================+======================| | 0 NVIDIA A100-SXM4-40GB On | 00000000:07:00.0 Off | 0 | | N/A 75C P0 389W / 400W | 20959MiB / 40960MiB | 100% Default | | | | Disabled | +-----------------------------------------+----------------------+----------------------+ +---------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=======================================================================================| | 0 N/A N/A 9175 C python 20938MiB | +---------------------------------------------------------------------------------------+ ``` ### Framework versions - Unsloth - Torch - PEFT 0.10.0