Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,137 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- salient-object-detection
|
| 5 |
+
- remote-sensing
|
| 6 |
+
- computer-vision
|
| 7 |
+
- multimodal
|
| 8 |
+
- pytorch
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
<a id="top"></a>
|
| 12 |
+
<div align="center">
|
| 13 |
+
<h1>๐ HFCNet: Heterogeneous Feature Collaboration Network for Salient Object Detection in Optical Remote Sensing Images</h1>
|
| 14 |
+
|
| 15 |
+
<p>
|
| 16 |
+
<b>Yutong Liu</b><sup>1</sup>
|
| 17 |
+
<b>Mingzhu Xu</b><sup>1</sup>
|
| 18 |
+
<b>Tianxiang Xiao</b><sup>1</sup>
|
| 19 |
+
<b>Haoyu Tang</b><sup>1</sup>
|
| 20 |
+
<b>Yupeng Hu</b><sup>1โ</sup>
|
| 21 |
+
<b>Liqiang Nie</b><sup>1</sup>
|
| 22 |
+
</p>
|
| 23 |
+
|
| 24 |
+
<p>
|
| 25 |
+
<sup>1</sup>Affiliation (Please update if needed)
|
| 26 |
+
</p>
|
| 27 |
+
</div>
|
| 28 |
+
|
| 29 |
+
Official implementation of **HFCNet**, a Heterogeneous Feature Collaboration Network for Salient Object Detection (SOD) in Optical Remote Sensing Images.
|
| 30 |
+
|
| 31 |
+
๐ **Journal:** IEEE Transactions on Geoscience and Remote Sensing (TGRS), 2024
|
| 32 |
+
๐ **Task:** Salient Object Detection (SOD)
|
| 33 |
+
๐ **Framework:** PyTorch
|
| 34 |
+
|
| 35 |
+
---
|
| 36 |
+
|
| 37 |
+
## ๐ Model Information
|
| 38 |
+
|
| 39 |
+
### 1. Model Name
|
| 40 |
+
**HFCNet** (Heterogeneous Feature Collaboration Network)
|
| 41 |
+
|
| 42 |
+
---
|
| 43 |
+
|
| 44 |
+
### 2. Task Type & Applicable Tasks
|
| 45 |
+
- **Task Type:** Salient Object Detection / Remote Sensing
|
| 46 |
+
- **Core Task:** Salient object detection in optical remote sensing imagery
|
| 47 |
+
- **Applicable Scenarios:**
|
| 48 |
+
- Remote sensing scene understanding
|
| 49 |
+
- Aerial object detection
|
| 50 |
+
- Environmental monitoring
|
| 51 |
+
|
| 52 |
+
---
|
| 53 |
+
|
| 54 |
+
### 3. Project Introduction
|
| 55 |
+
|
| 56 |
+
Salient Object Detection (SOD) in remote sensing images is challenging due to complex backgrounds, scale variations, and heterogeneous feature distributions.
|
| 57 |
+
|
| 58 |
+
**HFCNet** proposes a Heterogeneous Feature Collaboration framework, which:
|
| 59 |
+
|
| 60 |
+
- Integrates multi-level heterogeneous features
|
| 61 |
+
- Enhances feature interaction and collaboration
|
| 62 |
+
- Improves representation of salient objects across scales
|
| 63 |
+
- Strengthens robustness against background interference
|
| 64 |
+
|
| 65 |
+
---
|
| 66 |
+
|
| 67 |
+
### 4. Training Data Source
|
| 68 |
+
|
| 69 |
+
Supported datasets:
|
| 70 |
+
|
| 71 |
+
- ORSSD
|
| 72 |
+
- EORSSD
|
| 73 |
+
- ORSI
|
| 74 |
+
|
| 75 |
+
---
|
| 76 |
+
|
| 77 |
+
## ๐ Pre-trained Weights
|
| 78 |
+
|
| 79 |
+
### Initialization Weights
|
| 80 |
+
|
| 81 |
+
Download backbone weights:
|
| 82 |
+
|
| 83 |
+
- Swin Transformer
|
| 84 |
+
- VGG16
|
| 85 |
+
|
| 86 |
+
Place `.pth` files into:./pretrained
|
| 87 |
+
|
| 88 |
+
|
| 89 |
+
---
|
| 90 |
+
|
| 91 |
+
### Trained Weights
|
| 92 |
+
|
| 93 |
+
Download trained model weights:
|
| 94 |
+
|
| 95 |
+
- Baidu Cloud: https://pan.baidu.com/s/1bVC4uxf3xKhLRcC08EQKMQ?pwd=hfcn
|
| 96 |
+
|
| 97 |
+
---
|
| 98 |
+
|
| 99 |
+
## ๐ Training
|
| 100 |
+
|
| 101 |
+
1. Download datasets and pre-trained weights
|
| 102 |
+
2. Prepare dataset path lists (.txt files)
|
| 103 |
+
3. Update dataset paths in config files
|
| 104 |
+
|
| 105 |
+
### Run training:
|
| 106 |
+
|
| 107 |
+
```bash
|
| 108 |
+
nohup python -u main.py --flag train --model_id HFCNet --config config/dataset_o.yaml --device cuda:0 > train_ORSSD.log &
|
| 109 |
+
|
| 110 |
+
nohup python -u main.py --flag train --model_id HFCNet --config config/dataset_e.yaml --device cuda:0 > train_EORSSD.log &
|
| 111 |
+
|
| 112 |
+
nohup python -u main.py --flag train --model_id HFCNet --config config/dataset_orsi.yaml --device cuda:0 > train_ORSI.log &
|
| 113 |
+
|
| 114 |
+
## ๐ Testing
|
| 115 |
+
mkdir ./modelPTH-ORSSD
|
| 116 |
+
python main.py --flag test --model_id HFCNet --config config/dataset_o.yaml
|
| 117 |
+
|
| 118 |
+
mkdir ./modelPTH-EORSSD
|
| 119 |
+
python main.py --flag test --model_id HFCNet --config config/dataset_e.yaml
|
| 120 |
+
|
| 121 |
+
mkdir ./modelPTH-ORSI
|
| 122 |
+
python main.py --flag test --model_id HFCNet --config config/dataset_orsi.yaml
|
| 123 |
+
|
| 124 |
+
## โ ๏ธ Notes
|
| 125 |
+
Designed for academic research
|
| 126 |
+
Performance depends on dataset characteristics
|
| 127 |
+
Requires GPU for efficient training
|
| 128 |
+
|
| 129 |
+
## ๐Citation
|
| 130 |
+
@ARTICLE{HFCNet,
|
| 131 |
+
author={Liu, Yutong and Xu, Mingzhu and Xiao, Tianxiang and Tang, Haoyu and Hu, Yupeng and Nie, Liqiang},
|
| 132 |
+
journal={IEEE Transactions on Geoscience and Remote Sensing},
|
| 133 |
+
title={Heterogeneous Feature Collaboration Network for Salient Object Detection in Optical Remote Sensing Images},
|
| 134 |
+
year={2024},
|
| 135 |
+
volume={62},
|
| 136 |
+
pages={1-14}
|
| 137 |
+
}
|