PrunaAI
/

mosaicml-mpt-7b-bnb-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mosaicml-mpt-7b-bnb-4bit-smashed / fc.py

sharpenb's picture

Upload folder using huggingface_hub (#1)

2868357 verified 7 months ago

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass