chat-nface / README.md
LucaVivona's picture
fix error handel with props
98da231

Gradio Flow

πŸ‘‹ Reach Me For Inquiry or Bugs

@Discord-Server: Hugging Face https://discord.com/invite/feTf9x3ZSB
@Discord-Name : Luca Vivona

What Is Gradio Flow

A web application with a backend in Flask and frontend in React, and React flow node base environment to stream both Gradio ( and later Streamlit ) interfaces, within a single application.

Tabel Of Contents πŸ“š

Application πŸ›οΈ

Dark-Application Light-Application

Updates βš’οΈ

Backend πŸ’½

  • errors within the function InterLauncher fixed
  • port mapping fixed
  • removed test prints
  • __init__ function takes inputs within class wrapper
  • better determine registered functions within classes
  • more examples located in the backend/src/example
    • just import and launch or run them within the demoE.py file in backend/src
  • launch interface functions that takes the interface and appends it within the gradio-flow so if it's (load, from_pipline, Block, or any other prebuilt interface you have you can append them into Gradio-Flow)
def InterLauncher(name, interface, listen=2000, **kwargs):
    port= kwargs["port"] if "port" in kwargs else DOCKER_PORT.determinePort()
    try:
        requests.post(f"http://{DOCKER_LOCAL_HOST}:{listen}/api/append/port", json={"port" : port, "host" : f'http://localhost:{port}', "file" : "Not Applicable", "name" : name, "kwargs" : kwargs})
    except Exception as e:
        print(f"**{bcolor.BOLD}{bcolor.FAIL}CONNECTION ERROR{bcolor.ENDC}** πŸ›The listening api is either not up or you choose the wrong port.πŸ› \n {e}")
        return

    interface.launch(server_port=port,
                     server_name=f"{DOCKER_LOCAL_HOST}",
                     inline= kwargs['inline'] if "inline" in kwargs else True,
                     share=kwargs['share'] if "share" in kwargs else None,
                     debug=kwargs['debug'] if "debug" in kwargs else False,
                     enable_queue=kwargs['enable_queue'] if "enable_queue" in kwargs else None,
                     max_threads=kwargs['max_threads'] if "max_threads" in kwargs else None,
                     auth=kwargs['auth'] if "auth" in kwargs else None,
                     auth_message=kwargs['auth_message'] if "auth_message" in kwargs else None,
                     prevent_thread_lock=kwargs['prevent_thread_lock'] if "prevent_thread_lock" in kwargs else False,
                     show_error=kwargs['show_error'] if "show_error" in kwargs else True,
                     show_tips=kwargs['show_tips'] if "show_tips" in kwargs else False,
                     height=kwargs['height'] if "height" in kwargs else 500,
                     width=kwargs['width'] if "width" in kwargs else 900,
                     encrypt=kwargs['encrypt'] if "encrypt" in kwargs else False,
                     favicon_path=kwargs['favicon_path'] if "favicon_path" in kwargs else None,
                     ssl_keyfile=kwargs['ssl_keyfile'] if "ssl_keyfile" in kwargs else None,
                     ssl_certfile=kwargs['ssl_certfile'] if "ssl_certfile" in kwargs else None,
                     ssl_keyfile_password=kwargs['ssl_keyfile_password'] if "ssl_keyfile_password" in kwargs else None,
                     quiet=kwargs['quiet'] if "quiet" in kwargs else False)
    
    try:
        requests.post(f"http://{DOCKER_LOCAL_HOST}:{ listen }/api/remove/port", json={"port" : port, "host" : f'http://localhost:{port}', "file" : 'Not Applicable', "name" : name, "kwargs" : kwargs})
    except Exception as e:    
        print(f"**{bcolor.BOLD}{bcolor.FAIL}CONNECTION ERROR{bcolor.ENDC}** πŸ›The api either lost connection or was turned off...πŸ› \n {e}")

Frontend πŸ–₯️

Node Menu

In The Works 🚧

  • Mutiple windows within the react-flow environment
  • Appending streamlit into gradio-flow
  • Directory tree search that looks for files that contain classes and functions that are registered under the decorators that are in backend/src/resources allowing you to append all your registered functions with only using the frontend.

App Architecture πŸ—οΈ

architecture

Prerequisites πŸ“

You will need: (Docker build 🐳 Currently Only on: Linux/Windows/Mac)

(Running Without docker)

  • 🐍 Python 3.2+ (backend)
  • npm 8.5.0 (frontend)
  • node v16.14.2 (frontend)

Running The App πŸ–₯️

Starting up it's simple as every command is already within the Makefile.

Makefile Run (Docker 🐳)

1. Running the docker container

make up
// command running: docker-compose up -d --remove-orphans;
// **Ubuntu** sudo make up

The React application will be running on http://localhost:3001 and the Flask will be running on http://localhost:2000

2. Entering the backend enviorment

make environment
// command running: docker exec -it backend bash;
// **Ubuntu** sudo make environment

Now that you're within the docker backend container environment you can start adding gradio/streamlit nodes within the frontend. (Extra Note) You do not need to be within the container environment to append nodes there is a feature to just run your own gradio application and then append it within the frontend by using the + button.

3. Appending Nodes To Frontend From The Backend

> cd ./src/demo
> python demo.py -l 2000
//run example gradio application

Non-Docker Build

1. Build Frontend (within the directory ./frontend)

npm install

2. Run Frontend (within the directory ./frontend)

npm start

3. Build Backend Dependency (within the directory ./backend)

pip install -r requirements.txt

4. Run Backend (within the directory backend)

python app.py -p 2000
//**NOTE** -p 2000 just assignes it localhost port 2000 anyother port will not work

5. Run Gradio within Gradio-Flow

It is quite simple, and similar within the docker build, the first way you can append your gradio to the Gradio flow is through running your application at a reachable url that is provided ed when you run Gradio and appending it via + button within the frontend, another way that is possible is that within the directory ./backend/src/resources there is a code that you can use to convert your own class or functional base code into basic gradio tabular interface by using decorators, these decorators will send the nesarry information to the backend flask api and update the frontend menu state in which you'll will be able to interact with it within the front end creating a hub for gradio build functions(read more here or look at the code here ).

NOTE If you use the gradio decorator compiler for gradio flow you need to set a listen port to 2000 or else the api will never get the key and will throw you an error, I'll also provided an example below if this isn't clear.

# (functional base)
##########
from resources import register, tabularGradio

@register(["text"], ["text"], examples=[["Luca Vivona"]])
def Hello_World(name):
        return f"πŸ‘‹ Hello {name}, and welcome to Gradio Flow πŸ€—" 

if __name__ == "__main__":
    # run single gradio
    tabularGradio([Hello_World])  # tabularGradio([Hello_World], ["Greeting"])

    # run it within Gradio-Flow
    # tabularGradio([Hello_World], listen=2000) # tabularGradio([Hello_World], ["Greeting"], listen=2000)
    
#(Class Base)
###########
from resources import GradioModule, register

@GradioModule
class Greeting:

    @register(["text"], ["text"], examples=[["Luca Vivona"]])
    def Hello_World(self, name):
        return f"πŸ‘‹ Hello {name}, and welcome to Gradio Flow πŸ€—" 

if __name__ == "__main__":
    # run just gradio
    Greeting().launch()
    # run it within Gradio-flow
    # Greeting().launch(listen=2000)

More Demos βž•

Within the backend/src/demo directory there are some demos

# type : class | function | load | None
# port : 2000 | None 
# python demo.py -e [type] -l [port]
(e.g)
> python demo.py -e class -l 2000
> python demo.py -e class