semvec/pypi-packages huggingface dataset:
striebel.bib 0.0.1
Stub files to use as the basis of a Python project that can be packaged and uploaded to PyPI
License: MIT

.. image:: https://img.shields.io/pypi/v/striebel.bib
   :alt: PyPI
   :target: https://pypi.org/project/striebel.bib

.. image:: https://static.pepy.tech/badge/striebel.bib
   :alt: Downloads
   :target: https://pepy.tech/project/striebel.bib

.. image:: https://img.shields.io/github/license/striebel/striebel.bib
   :alt: License
   :target: https://github.com/striebel/striebel.bib/blob/master/LICENSE 

.. image:: https://img.shields.io/badge/python_3-gray
   :alt: Python 3
   :target: https://docs.python.org/3/

.. image:: https://img.shields.io/badge/linux-gray
   :alt: Linux
   :target: https://kernel.org/

The ``python-project-stub`` codebase provides stub files that
can be used to create a Python project that is able to
be packaged and uploaded to the Python Package Index
and hence can be conveniently installed with

.. code-block:: sh
   
   pip install my-project-name
   
The ``Makefile`` provided in the codebase has targets for
building, uploading,
downloading, installing, and executing the package.

Project links
-------------

* Repo: `https://github.com/striebel/striebel.bib
  <https://github.com/striebel/striebel.bib>`_
* PyPI: `https://pypi.org/project/striebel.bib
  <https://pypi.org/project/striebel.bib>`_
* Docs: `https://striebel.github.io/striebel.bib
  <https://striebel.github.io/striebel.bib>`_
fastspeed 0.1.1
Fastspeed is a toolkit for serving LLM.
License: MIT
Requires Python: >=3.6

# Fastspeed
Fastspeed is a toolkit for serving LLM.

## Requirements
- Python >= 3.6

## Installation
```shell
pip install fastspeed
```

## Example
- server
```sh
fastspeed --model model_name_or_path  # default model_hub=modelscope
fastspeed --model model_name_or_path --model_hub hf
```

- client
```sh
curl -X 'POST' \
  'http://127.0.0.1:8000/chat/completions' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "messages": [
    {
      "role": "user",
      "content": "Hello"
    }
  ],
  "model": ""
}'
```


# Change Log

## 0.1.1 (2024-09-15)
- Suport half, cuda and trust_remote_code=True

## 0.1.0 (2024-08-29)
- Fastapi with single GPU, model from huggingface or modelscope