|
--- |
|
title: Template Node WizardCoder Express |
|
emoji: 🧙 |
|
colorFrom: blue |
|
colorTo: purple |
|
sdk: docker |
|
pinned: false |
|
app_port: 7860 |
|
--- |
|
|
|
A minimalist Docker space to help people getting started with Node, WizardCoder (through CTransformers and Pythonia), Express and TypeScript. |
|
Ready to be used in a Hugging Face Space. |
|
|
|
|
|
# Examples |
|
|
|
## Live example |
|
|
|
Note: the space make take a few minutes to start. |
|
If it begins outputing bad HTML, release the page. |
|
|
|
https://huggingface.co/spaces/jbilcke-hf/template-node-wizardcoder-express?prompt=the%20landing%20page%20of%20a%20dog%20sitting%20company%20operating%20in%20NYC |
|
|
|
## Local prompt examples |
|
|
|
http://localhost:7860/?prompt=a%20landing%20page%20for%20a%20company%20called%20Hugging%20Face |
|
http://localhost:7860?prompt=the%20landing%20page%20of%20a%20dog%20sitting%20company%20operating%20in%20NYC |
|
|
|
## Installation |
|
|
|
### Prerequisites |
|
|
|
- Install NVM: https://github.com/nvm-sh/nvm |
|
- Install Docker https://www.docker.com |
|
|
|
### CTransformers |
|
|
|
This project relies on CTransformers called through Pythonia. |
|
|
|
To install ctransformers: |
|
|
|
```bash |
|
pip install ctransformers |
|
# or this, depending on your Python environment: |
|
# pip3 install ctransformers |
|
``` |
|
|
|
For GPU (CUDA) support set environment variable CT_CUBLAS=1 and install from source using: |
|
|
|
```bash |
|
CT_CUBLAS=1 pip install ctransformers --no-binary ctransformers |
|
# or this, depending on your Python environment: |
|
# CT_CUBLAS=1 pip3 install ctransformers --no-binary ctransformers |
|
``` |
|
|
|
### Building and run without Docker |
|
|
|
```bash |
|
nvm use |
|
npm i |
|
npm run start |
|
``` |
|
|
|
### Building and running with Docker |
|
|
|
```bash |
|
npm run docker |
|
``` |
|
|
|
This script is a shortcut executing the following commands: |
|
|
|
```bash |
|
docker build -t template-node-wizardcoder-express . |
|
docker run -it -p 7860:7860 template-node-wizardcoder-express |
|
``` |
|
|
|
Attention! If you have a Mac, you may have trouble running the project on your machine. |
|
|
|
You will see the following error message because Docker won't be able to use the pre-generated binaries for `libctransformers.so` due to architecture incompatibility: |
|
|
|
``` |
|
🌉 OSError: /home/user/.local/lib/python3.11/site-packages/ctransformers/lib/avx2/libctransformers.so: cannot open shared object file: No such file or directory] |
|
``` |
|
|
|
However if you run your project on a Hugging Face space, you should be just fine :) |
|
|
|
### Deployment to Hugging Face |
|
|
|
The standard free CPU instance (16 Gb) will not be enough for WizardCoder, you should use the upgraded CPU instance (32 Gb) |
|
|
|
I haven't upgraded mine yet, so it will probably crash when you try it: |
|
https://huggingface.co/spaces/jbilcke-hf/template-node-wizardcoder-express |
|
|
