simplified_phi2 / streaming_inference.py

Commit History

Fixed inference script bug and made deterministic
4f25dda

BucketOfFish commited on

Passing KV cache through iterations
c07c430

BucketOfFish commited on

Fixed weight loading from original Phi2 model
10aca20

BucketOfFish commited on

Renaming state dict keys from Phi2
78f6f3b

BucketOfFish commited on

Updated imports in script
16cc769

BucketOfFish commited on

Streaming inference script
dc6124b

BucketOfFish commited on