martintmv commited on
Commit
bc63e69
β€’
1 Parent(s): efe3dc1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -1
README.md CHANGED
@@ -8,4 +8,60 @@ sdk_version: '3.0'
8
  app_file: app.py
9
  pinned: false
10
  short_description: InsectSAM + GroundingDINO Inference
11
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  app_file: app.py
9
  pinned: false
10
  short_description: InsectSAM + GroundingDINO Inference
11
+ ---
12
+
13
+ # InsectSAM 🐞
14
+
15
+ ![InsectSAM Hugging Face App](https://i.imgur.com/cCgpvx9.png)
16
+
17
+ ## Results in Development
18
+
19
+ ![Results in Development](https://i.ibb.co/591nr5Y/Screenshot-2024-05-31-at-17-04-34.png)
20
+
21
+ ## Insect Detection and Dataset Preparation for DIOPSIS and ARISE Algorithms
22
+
23
+ This application facilitates the preprocessing of images for subsequent analysis using the DIOPSIS and ARISE algorithms, focusing on insect biodiversity detection. It leverages advanced deep learning models, including the InsectSAM model developed by Fontys UAS Eindhoven's team RB-IBDM and the GroundingDINO model by IDEA Research. By annotating images with bounding boxes, labels, and masks, this preprocessing step enhances the suitability of images for running on the DIOPSIS and ARISE algorithms.
24
+
25
+ ## Description
26
+
27
+ The primary goal of this application is to prepare images with insects for further analysis using the DIOPSIS and ARISE algorithms. These algorithms are essential for detecting and analyzing insect biodiversity, but they require images that are appropriately preprocessed to ensure accurate results.
28
+
29
+ To achieve this, the application employs deep learning models for insect detection and segmentation. The InsectSAM model is utilized to segment insects within images, while the GroundingDINO model enables zero-shot object detection of insects. By combining these models, the application can accurately identify insects within images, even in diverse and complex backgrounds to which insects are naturally attracted.
30
+
31
+ Furthermore, the application generates annotations such as bounding boxes and masks, providing valuable information about the location and shape of detected insects. These preprocessing steps are crucial for the subsequent analysis performed by the DIOPSIS and ARISE algorithms, ensuring that they can effectively identify and quantify insect biodiversity.
32
+
33
+ ## Installation
34
+
35
+ To use this application, follow these steps:
36
+
37
+ 1. Clone this repository to your local machine.
38
+ 2. Create a conda environment for the project.
39
+ 3. Install the required dependencies by running `pip install -r requirements.txt`.
40
+
41
+ ## Usage
42
+
43
+ Once the installation is complete, you can run the application by executing the `app.py` script:
44
+
45
+ ```bash
46
+ python app.py
47
+ ```
48
+
49
+ This will launch a Gradio interface where you can upload images and visualize the detected insects along with the generated annotations.
50
+
51
+ ## Acknowledgments
52
+
53
+ - **InsectSAM**: Developed by Fontys UAS Eindhoven's team RB-IBDM, the InsectSAM model is utilized for insect segmentation.
54
+ - **GroundingDINO**: Developed by IDEA Research, GroundingDINO is employed for zero-shot object detection of objects.
55
+ - **DIOPSIS and ARISE Algorithms**: These algorithms are utilized for insect biodiversity detection.
56
+
57
+ ## References
58
+
59
+ - [InsectSAM Hugging Face App](https://huggingface.co/spaces/martintmv/InsectSAM)
60
+ - [InsectSAM Hugging Face Repository](https://huggingface.co/martintmv/InsectSAM)
61
+ - [GroundingDINO Hugging Face Repository](https://huggingface.co/IDEA-Research/grounding-dino-base)
62
+
63
+ For more details on the models and algorithms used in this application, please refer to the respective repositories.
64
+
65
+ ---
66
+
67
+ **Disclaimer**: This application is for demonstration purposes only and should not be used for critical insect detection tasks without proper evaluation and validation.