Spaces:
Runtime error
A newer version of the Gradio SDK is available:
4.42.0
title: GPT4Tools
emoji: π
colorFrom: indigo
colorTo: pink
sdk: gradio
sdk_version: 3.32.0
app_file: app.py
pinned: false
license: apache-2.0
GPT4Tools: Teaching LLM to Use Tools via Self-instruction
Lin Song, Yanwei Li, Rui Yang, Sijie Zhao, Yixiao Ge, Ying Shan
GPT4Tools is a centralized system that can control multiple visual foundation models. It is based on Vicuna (LLaMA), and 71K self-built instruction data. By analyzing the language content, GPT4Tools is capable of automatically deciding, controlling, and utilizing different visual foundation models, allowing the user to interact with images during a conversation. With this approach, GPT4Tools provides a seamless and efficient solution to fulfill various image-related requirements in a conversation. Different from previous work, we support users teach their own LLM to use tools with simple refinement via self-instruction and LoRA.
ArXiv url: https://arxiv.org/abs//2305.18752