John Leimgruber III

ubergarm's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in gradientai/Llama-3-70B-Instruct-Gradient-262k 16 days ago

Prompt Format

4

#6 opened about 1 month ago by JamesConley

New activity in OpenGVLab/InternVL-Chat-V1-5 29 days ago

Quantized model coming?

7

#3 opened about 2 months ago by dnhkng

New activity in failspy/InternVL-Chat-V1-5-4bit 29 days ago

Output is empty

2

#3 opened about 1 month ago by bingw5

New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 about 1 month ago

~8 tok/sec with ~5k context on vLLM with Flash Attention and `kv_cache_dtype="fp8"` on 3090TI 24GB VRAM

2

#2 opened about 1 month ago by ubergarm

New activity in MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.3-32k-GGUF about 2 months ago

The f16 with 32k ctx fits nicely in 24GB VRAM

5

#3 opened about 2 months ago by ubergarm

New activity in stabilityai/stable-cascade 4 months ago

AttributeError: 'generator' object has no attribute 'image_embeddings'

1

#26 opened 4 months ago by MohamedRashad