What's going on in the Zilliz Universe? December 2023
Tags: opensource, ai, vectordatabase, devimpact2023
Published: 2023-12-20 17:51:41

To wrap up 2023, here are some vector database resources and a sneak peek into the new year! 🌟

#🎄Open Source Advent 
There are still a few days left of [Zilliz’s Open Source Advent](https://zilliz.com/open-source-advent?utm_source=referral&utm_medium=partner&utm_campaign=2023-12-20_linkedin-newsletter-repost-devto)! Did you know that the projects can be done in 30 minutes? Check all the projects in our [Contest Discord](https://discord.gg/R5ezcZ3Xm8). 

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/2gl1m6u5530mfsgm9yhz.jpeg)

Get your points submitted [here](https://docs.google.com/forms/d/e/1FAIpQLSfTJhavxxA7Ip6qDFv8Flg9W4681vvz4OBHzPU8JWB_l9QVBw/viewform) by January 2nd, 2024 for a chance to win swag! Winners will be announced on January 8th, 2024. Good luck!


#🔎 Zilliz Cloud Pipelines - high-quality vector transformation made easy and fast 


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6y834j91t5twx7dzm05l.png)

[Zilliz Cloud Pipelines](https://zilliz.com/zilliz-cloud-pipelines?utm_source=referral&utm_medium=partner&utm_campaign=2023-12-20_linkedin-newsletter-repost-devto) is a one-stop solution designed to simplify and streamline the transformation of unstructured data into optimized vector embeddings.

With Zilliz Cloud Pipelines, developers can:
1. Use an **ingestion pipeline** to process unstructured data into searchable vector embeddings
2. Use a **search pipeline** to enable semantic search by converting query text into vector embeddings
3. Use a **deletion pipeline** to efficiently remove all chunks of a specified document from a collection

▶️ [Read Blog](https://zilliz.com/blog/introducing-zilliz-cloud-pipelines-one-stop-service-building-ai-powered-search?utm_source=referral&utm_medium=partner&utm_campaign=2023-12-20_linkedin-newsletter-repost-devto)
📷 [Watch Demo](https://www.youtube.com/watch?v=WDJq5MSPFWo)
🦙 [Notebook using Pipelines inside LlamaIndex](https://github.com/run-llama/llama_index/blob/b900c7cbd9fc7d14699f615e48117d03c1d58ceb/docs/examples/managed/zcpDemo.ipynb)

Get started for free [here](https://cloud.zilliz.com/signup?utm_source=referral&utm_medium=partner&utm_campaign=2023-12-20_linkedin-newsletter-repost-devto). 

#😎 Choosing a vector database based on your needs

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/cz0ekd9xo6fxkpt716kf.jpeg)

Check out this new article on InfoWorld [How to evaluate a vector database](https://www.infoworld.com/article/3711281/how-to-evaluate-a-vector-database.html) by Li Liu, Principal Engineer at Zilliz. He deep-dives into the top 3 metrics when assessing a vector database: scalability, functionality, and performance. Read about these crucial metrics and learn more [here](https://www.infoworld.com/article/3711281/how-to-evaluate-a-vector-database.html). 

#👀 Looking ahead to 2024
Share your 2024 AI resolutions on this LinkedIn post 👇

{% embed https://www.linkedin.com/feed/update/urn:li:activity:7142581585261842433/ %}

#🗓️ Mark your Calendars for January 2024 Events

### January 11  - Vector Database 101: A Crash Course (_virtual_) 


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/93tpuamlth7aspord5oy.png)

Hear from Developer Advocate Yujian Tang at our crash course webinar on January 11 covering vector database use cases and more! 

Crash Course topics include:

- Why unstructured data is hard to work with
- An overview of common use cases that benefit from vector databases
- How to get your unstructured data into a vector database
- What to consider when evaluating and building your own vector database
- How to avoid common mistakes when getting started with a vector database

Register [here](https://zilliz.com/event/vector-database-101-crash-course?utm_source=referral&utm_medium=partner&utm_campaign=2023-12-20_linkedin-newsletter-repost-devto).

### January 16 - Unstructured Data Meetup SF (_in-person_) 

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/h5vm3g51ijk2kbqutfka.png)

Zilliz will be back at GitHub in San Francisco for our monthly Unstructured Data Meetup on January 16! Join us to learn about the following topics:

▶️ How to extract Tabular Data from PDFs for RAG Pipelines using Milvus with Jack Retterer
▶️ Vector Search in the Age of OpenAI Assistants using Milvus with Christy Bergman 
▶️ Are CPUs Enough? A Review Of Vector Search Running On Novel Hardware with George Williams

Register here: https://lu.ma/vq31dazy 

See you in the new year! 👋