PrunaAI
/

mosaicml-mpt-7b-8k-bnb-8bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

mosaicml-mpt-7b-8k-bnb-8bit-smashed / fc.py

sharpenb's picture

Upload folder using huggingface_hub (#1)

f8fbdd5 verified 7 months ago

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass