fc.py · mosaicml/mpt-7b at main

mpt-7b / fc.py

LLM-foundry update October 17, 2023 23:04:30 (#82)

00f72b2 7 months ago

No virus

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass