#8 changed to mixtral 8x7b

README.md

@@ -1,11 +1,116 @@
+# TALKING DUCK 🦆
+
+Welcome to the coolest corner of the coding pond - <a href="https://huggingface.co/spaces/sinatayebati/Talking-Duck">**TALKING DUCK**!</a> This isn't just any duck. It's your feathered friend that quacks code solutions and dives deep into programming puzzles. Ever wished for a coding buddy that could talk back, understand your code woes, and not just stare blankly at you? **TALKING DUCK** is here to change the game!
+
+Dive in beak-first and see TALKING DUCK in action over at its very own <a href="https://huggingface.co/spaces/sinatayebati/Talking-Duck">Hugging Face Space</a>. It's like a pond party for coders, and you're invited! 🎉 
+
+
+## What's the Quack?
+
+**TALKING DUCK** is an LLM-powered chatbot that does more than just float around. It listens (literally) to your code problems, thanks to its audio-to-text superpower, and then it gets its webbed feet dirty by diving into the depths of code logic to bring you pearls of wisdom... or at least, the answers to your coding questions.
+
+Whether you're tangled in the vines of Python, lost in the braces of JavaScript, or just need someone to tell you "It's gonna be okay, buddy," **TALKING DUCK** is your go-to aquatic ally.
+
+## Features
+
+- 🎤 **Audio Input**: Just quack your question into your mic.
+- 🤔 **Smart Analysis**: Leveraging the brainy might of LLM models, including the one and only `mistralai/Mistral-7B-v0.1`.
+- 💡 **Insightful Answers**: Get recommendations, solutions, and sometimes just a friendly quack.
+- 🦆 **Fun Interface**: Because who said coding assistants need to be boring?
+
+
+# Get Started
+To build Talking Duck, you could build from docker or setup a conda environment.
+
+
+## Docker Setup
+
+If you prefer to keep your machine clean and run everything in containers, **TALKING DUCK** is Docker-ready! Just follow these simple steps to containerize the quack:
+
+### Build the Docker Image
+
+Navigate to the root directory of the cloned project where the `Dockerfile` is located, and run:
+
+```bash
+docker build -t talking-duck .
+```
+
+This command builds a Docker image named `talking-duck` based on the instructions in your `Dockerfile`.
+
+### Run the Container
+
+Once the build is complete, you can run **TALKING DUCK** in a Docker container using:
+
+```bash
+docker run -p 7860:7860 talking-duck
+```
+
+This command starts a container from the `talking-duck` image, mapping port 7860 of the container to port 7860 on your host machine. 
+
+### Visit Your Duck
+
+Open your favorite web browser and navigate to `http://localhost:7860` to interact with **TALKING DUCK**. No installation mess, just pure, unadulterated duck fun.
+
+### Docker Compose (Optional)
+
+For an even easier setup, if you have a `docker-compose.yml` file at the root of your project, you can start **TALKING DUCK** with just one command:
+
+```bash
+docker-compose up --build
+```
+
+This command uses Docker Compose to build the image and run the container as defined in your `docker-compose.yml` file. It's perfect for when you want to get up and running with minimal fuss.
+
+---
+
+**Note:** Be sure to adjust the `docker build` and `docker run` commands based on your specific Docker setup, including the correct image names and any additional options you might need. The instructions above assume a basic setup for demonstration purposes.
+
+Don't forget to check the Docker and Docker Compose documentation for more detailed information on building and running containers.
+
+## Env setup
+
+Want your very own **TALKING DUCK**? Follow these steps to clone this repository and get quacking:
+
+
+1. **Clone the Repository**
+
+    ```bash
+    git clone https://github.com/your-username/talking-duck.git
+    cd talking-duck
+    ```
+
+2. **Set Up Your Pond**
+
+    Make sure you have Python installed, then dive in with:
+
+    ```bash
+    pip install -r requirements.txt
+    ```
+
+3. **Wake the Duck**
+
+    Start your **TALKING DUCK** with:
+
+    ```bash
+    python app.py
+    ```
+
+    Visit `http://localhost:7860` in your web browser to see **TALKING DUCK** in all its glory!
+
+
+Sure! Here’s an addition to the README that includes instructions for building and running the **TALKING DUCK** project using Docker. This section assumes that you’ve Dockerized your Gradio app, as discussed earlier.
+
 ---
-title: Talking Duck
-emoji: 📉
-colorFrom: yellow
-colorTo: indigo
-sdk: docker
-pinned: false
-license: mit
+
+
+## Contribute
+
+Got ideas to make **TALKING DUCK** even cooler? Fork this repo, make your changes, and submit a pull request. New jokes, features, and improvements are always welcome. Let's make coding fun together!
+
+## License
+
+**TALKING DUCK** is released under the MIT License. See `LICENSE` for more information.
+
 ---
 
-Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
+Remember to replace `https://github.com/your-username/talking-duck.git` with the actual URL of your repository. Feel free to adjust the tone and content to match your project's personality and features more closely!

app.py

@@ -5,7 +5,7 @@ import os
 
 API_TOKEN = os.getenv("HF_API_TOKEN")
 TRANSCRIBE_API_URL = "https://api-inference.huggingface.co/models/openai/whisper-base.en"
-LLM_API_URL = "https://api-inference.huggingface.co/models/mistralai/Mistral-7B-v0.1"
+LLM_API_URL = "https://api-inference.huggingface.co/models/mistralai/Mixtral-8x7B-Instruct-v0.1"
 
 def transcribe_audio(audio_file):
     """Transcribe audio file to text."""
@@ -39,7 +39,6 @@ def get_answer(context, question):
         "parameters": {
             "temperature": 0.3,  # More deterministic
             "top_p": 0.95,  # Consider top 90% probable tokens at each step
-            "max_new_tokens": 100,  # Limit the response length
             "repetition_penalty": 1.2,  # Discourage repetition
             "num_return_sequences": 1,  # Number of responses to generate
             "return_full_text": False,  # Return only generated text, not the full prompt
@@ -86,8 +85,8 @@ with gr.Blocks() as app:
         <div style="display: flex; justify-content: space-around; align-items: center;">
             <div>
                 <img src="https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/mistral-logo.png" alt="Mistral Logo" style="width: 40px; margin-bottom: 10px;"/>
-                <div style="font-size: 14px;">mistralai/Mistral-7B-v0.1</div>
-                <a href="https://huggingface.co/mistralai/Mistral-7B-v0.1" target="_blank" style="color: white; text-decoration: none; font-size: 12px;">Model Page</a>
+                <div style="font-size: 14px;">mistralai/Mixtral-8x7B-Instruct-v0.1</div>
+                <a href="https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1" target="_blank" style="color: white; text-decoration: none; font-size: 12px;">Model Page</a>
             </div>
             <div>
                 <img src="https://aeiljuispo.cloudimg.io/v7/https://cdn-uploads.huggingface.co/production/uploads/1620805164087-5ec0135ded25d76864d553f1.png?w=200&h=200&f=face" alt="Second Model Logo" style="width: 40px; margin-bottom: 10px;"/>

helper.txt

@@ -1,19 +1,17 @@
 # Ensure Docker Buildx is used and setup
 docker buildx create --use
 
-# Build your Docker image with Buildx (assuming you're now working locally and not pushing to a registry)
-docker buildx build --load --secret id=HF_API_TOKEN,env=HF_API_TOKEN -t gradio-app .
+#export your API token as a secret variable
+export HF_API_TOKEN="your_huggingface_api_token_here"
 
-# Now run your Docker container, passing the secret environment variable
-docker run -it -p 7860:7860 -e HF_API_TOKEN=$HF_API_TOKEN gradio-app
+echo $HF_API_TOKEN
 
 
-docker build -t gradio-app .
+# Build your Docker image with Buildx (assuming you're now working locally and not pushing to a registry)
+docker buildx build --load --secret id=HF_API_TOKEN,env=HF_API_TOKEN -t gradio-app .
 
+# Now run your Docker container, passing the secret environment variable
 docker run -it -p 7860:7860 -e HF_API_TOKEN=$HF_API_TOKEN gradio-app
 
-docker-compose up --build
-
-
-
- "--host", "0.0.0.0", "--port", "7860"
+# Use docker composer
+docker-compose up --build

licence

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2023 Sina Tayebati
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

requirements.txt

@@ -1,6 +1,3 @@
-fastapi==0.110.0
 gradio==4.21.0
 requests==2.31.0
-torch==1.11
-transformers==4.38.2
-uvicorn[standard]==0.28.0
+transformers==4.38.2