Deconstructing Embedding Models - MLOps London March-2024 Part 2
Channel: MLOps London
Date: 2024-03-19

Kacper Łukawski -- Developer Advocate at Qdrant

We will delve deep into the tokenizer's fundamental role, shedding light on its operations and introducing straightforward techniques to assess whether a particular model is suited to your data based solely on its tokenizer. We will explore the significance of the tokenizer in the fine-tuning process of embedding models and discuss strategic approaches to optimize its effectiveness.