view post Post 4766 smolagents now support vLLM! ๐ฅณAs one of the most popular local inference solutions, the community had been asking us to integrate vLLM: after a heavy refactoring of our LLM classes, we've just released smolagents 1.11.0, with a brand new VLLMModel class.Go try it and tell us what you think!https://github.com/huggingface/smolagents/blob/45b2c86857b7f7657daaa74e4d17d347e9e2c4a4/src/smolagents/models.py#L497 See translation ๐ค 9 9 ๐ฅ 5 5 ๐ 4 4 ๐ 1 1 ๐ 1 1 + Reply