Flash Diffusion Block Speculative Decoder on RM?

by JohnGenetica - opened 16 days ago

Is this currently being looked at as a speculative decoder option? Spent a lot of time working on a shared embedding space and then 12B sort of did one. I do not have a lot of budget for GPUs so I want to make sure I am picking my battles when looking for further uplift areas. Thank Ü. -JEA

JohnGenetica

15 days ago

Well that answers that... https://blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment