1112lee's picture
nice-model
9d6cb8e verified

LoKr

Low-Rank Kronecker Product (LoKr), is a LoRA-variant method that approximates the large weight matrix with two low-rank matrices and combines them with the Kronecker product. LoKr also provides an optional third low-rank matrix to provide better control during fine-tuning.

LoKrConfig

[[autodoc]] tuners.lokr.config.LoKrConfig

LoKrModel

[[autodoc]] tuners.lokr.model.LoKrModel