Full fp32 weight?
#8
by
MonikaDreamer
- opened
Where
use stochastic rounding on bf16 to train fp16 weights, should work fine
pipe = StableDiffusion3Pipeline.from_pretrained(
model,
low_cpu_mem_usage=False,
...
torch_dtype=torch.float32
)