Estimating Memory Consumption of LLMs for Inference and Fine-Tuning for Cohere Command-R+ By Andyrasika • about 4 hours ago • 2
Post-OCR-Correction: 1 billion words dataset of automated OCR correction by LLM By Pclanglais • about 5 hours ago • 4
LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!) By wolfram • 2 days ago • 28
Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU! By lyogavin • 5 days ago • 8
Estimating Memory Consumption of LLMs for Inference and Fine-Tuning for Cohere Command-R+ By Andyrasika • about 4 hours ago • 2
Post-OCR-Correction: 1 billion words dataset of automated OCR correction by LLM By Pclanglais • about 5 hours ago • 4
LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!) By wolfram • 2 days ago • 28
Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU! By lyogavin • 5 days ago • 8