PrunaAI
/

vinai-PhoGPT-4B-Chat-bnb-8bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

vinai-PhoGPT-4B-Chat-bnb-8bit-smashed / fc.py

sharpenb's picture

Upload folder using huggingface_hub (#1)

7486d07 verified 7 months ago

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass