semvec/pypi-packages huggingface dataset:
vllm-client 0.3.2.0
Client for the vLLM API with minimal dependencies
License: Apache 2.0
Requires Python: >=3.8

# vLLM Client

## Overview

Client for the [vLLM](https://github.com/vllm-project/vllm) API with minimal dependencies.

## Installation

```sh
pip install vllm-client
```

## Examples

See [example.py](example.py) for the following:
- Single generation
- Streaming
- Batch inference

It should work out of the box with a vLLM API server. 

## Notes

- `sampling_params.py` needs to be kept in sync with vLLM.
  It is a simplified version of their class, containing
  only the code required on client side.

## Another programming languages

- C# [VllmClient NuGet package](https://www.nuget.org/packages/VllmClient/)