phi-1 / modeling_phi.py

Commit History

fix(modeling_phi): Fixes initial generation with length larger than context length.
f4e55a8

gugarosa commited on

fix(modeling_phi): Fixes cached generation when above maximum context length.
ecfe56e

gugarosa commited on

Fixes exceeding maximum sequence length when using generate().
759d148

gugarosa commited on

Uses native torch decorator for disabling autocast.
5819d04

gugarosa commited on

Adds disable_autocast support for different device types.
67ecc75

gugarosa commited on

Fixes any potential overflow when calculating attention weights.
b5c5161

gugarosa commited on

Update to new model interface.
bbace88

gugarosa commited on