Bordoglor's picture
Upload folder using huggingface_hub
f472b08 verified

LoKr

Low-Rank Kronecker Product (LoKr), is a LoRA-variant method that approximates the large weight matrix with two low-rank matrices and combines them with the Kronecker product. LoKr also provides an optional third low-rank matrix to provide better control during fine-tuning.

LoKrConfig

[[autodoc]] tuners.lokr.config.LoKrConfig

LoKrModel

[[autodoc]] tuners.lokr.model.LoKrModel