A Fork Supporting SageMaker Deployment
#5
by
liltom-eth
- opened
Hi @liuhaotian I made a fork at anymodality/llava-v1.5-7b with tutorial to support deployment on SageMaker.
Let me know if you have any thoughts /ideas on it.
More details:
Trying to deploy liuhaotian/llava-v1.5-7b directly on SageMaker, and it is failed to invoke since llava is still not in transformers.
Figuring out this customized deployment by providing an inference.py file.
liltom-eth
changed discussion title from
A Fork to Support SageMaker Deployment
to A Fork Supporting SageMaker Deployment