FasterTransformer implementation

#9
by Meital - opened

Hi!
Thanks for your hard work.
I saw that you wrote that the model is compatible with fastertransformer inference.
Do you have a conversion script?
I couldn't see the model implementation in fastertransformer and it would be very beneficial for me :)

I am also intrested in this one
Has anyone had luck here?

Thanks !

Mosaic ML, Inc. org

Lets move this discussion here https://github.com/mosaicml/llm-foundry/issues/67 please :)

daking changed discussion status to closed

Sign up or log in to comment