Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
debisoft's picture
Initial Upload
5b303ca
from torch import nn
FC_CLASS_REGISTRY = {'torch': nn.Linear}
try:
import transformer_engine.pytorch as te
FC_CLASS_REGISTRY['te'] = te.Linear
except:
pass