google

/

gemma-2-27b-it

like 474

Follow

Google 5.93k

Hi @omenlyd , Sorry for late response, The MacBook Pro M3 Max with 48GB of RAM is unlikely to load and run the Gemma2-27B model in its entirety, even with optimizations like FP16.

For this scale of a model, you would generally need much more memory. Using a machine with at least 100GB of RAM or a dedicated GPU with substantial memory (e.g., A100, V100, etc.) would be more ideal.

Thank you.

@omenlyd https://huggingface.co/unsloth/gemma-2-27b-it-bnb-4bit try this model. ( its quantised, so the performance might be slightly degraded)