Matryoshka question training and inference
#2
by
aari1995
- opened
Hi there! Really cool model! I have a question though. Does it support matryoshka embeddings? For inference, how? And was it considered in training the Colbert part? I think it was considered in the embed model.
Thank you!
Hey, it's a "normal" colbert model. So no tricks for reducing memory footprint.
aamirshakir
changed discussion status to
closed