microsoft
/

phi-1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

phi-1 / modeling_phi.py

Commit History

fix(modeling_phi): Fixes initial generation with length larger than context length.

f4e55a8

gugarosa commited on Dec 8, 2023

fix(modeling_phi): Fixes cached generation when above maximum context length.

ecfe56e

gugarosa commited on Dec 5, 2023

Fixes exceeding maximum sequence length when using generate().

759d148

gugarosa commited on Nov 20, 2023

Uses native torch decorator for disabling autocast.

5819d04

gugarosa commited on Nov 16, 2023

Adds disable_autocast support for different device types.

67ecc75

gugarosa commited on Nov 16, 2023

Fixes any potential overflow when calculating attention weights.

b5c5161

gugarosa commited on Nov 16, 2023

Update to new model interface.

bbace88

gugarosa commited on Nov 9, 2023