Instructions to use mradermacher/Meta-Llama-3.1-405B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Meta-Llama-3.1-405B-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Meta-Llama-3.1-405B-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 6c3b898d3d9b749c5c3df652164e85d0584a832b6f7fe0e1071796905735b9d7
- Size of remote file:
- 47.2 GB
- SHA256:
- 3cee5e37b10b29f4e8607b871c2b23e1b961053ce66dd404ea1f66b6324202c9
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.