nomic-ai

/

nomic-embed-text-v1.5

like 224

I think we need a F.layer_norm equivalent before the slicing and norming. Is that possible in js?

Oh yes, good catch! It is possible in JS, but I would need to update the library to add the Tensor.layer_norm function.

I'll make a PR tonight for it, but it might be worth merging in the meantime (since the results are not dramatically different and the previous code snippet is still using v1).

Will do, please open that PR once you do have the update :)

Sounds good!

Transformers.js PR is here, and I will open a follow-up PR once we release the next version.

awesome!!