NikolaosDionelis2023 commited on
Commit
dd08eab
1 Parent(s): 5bb2736

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md CHANGED
@@ -1,3 +1,35 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ # Model: PhilEO Bench
6
+
7
+ A novel evaluation framework for EO Foundation Models.
8
+
9
+ ## Model Details
10
+
11
+ ### Model Description
12
+
13
+ The PhilEO Bench evaluation framework comprises of a testbed that can be used to test any EO Foundation Model. The three downstream tasks are building density estimation, road segmentation, and land cover classification.
14
+
15
+ - **Developed by:** ESA, Phi-lab
16
+ - **Model type:** Evaluation Framework
17
+ - **License:** MIT
18
+
19
+ The aim of Foundation Models is to improve the performance on several diverse downstream tasks. However, these models are often evaluated on a range of datasets with different characteristics (size, resolution, locations, satellite sources, and capture dates). There is also a focus on evaluating classification downstream tasks, while omitting image-to-image downstream tasks (such as segmentation). Therefore, it is challenging to fairly compare the performance of these burgeoning EO FMs and draw meaningful conclusions. To evaluate FMs, we propose the PhilEO Bench, an evaluation framework with the aim of providing a flexible, consistent, and fair benchmark for EO Sentinel-2 FMs.
20
+
21
+ ## Uses
22
+
23
+ The PhilEO Bench is used to evaluate EO Foundation Models. - We introduce a new flexible evaluation framework focused on generating comparable, fair, and reproducible results.
24
+
25
+ ### Model Sources
26
+
27
+ The basic links for the model are:
28
+
29
+ - **Repository:** http://huggingface.co/ESA-philab/PhilEO-Bench
30
+ - **Paper:** https://arxiv.org/pdf/2401.04464.pdf
31
+ - **arXiv:** https://arxiv.org/abs/2401.04464
32
+
33
+ ## Citation
34
+
35
+ Casper Fibaek, Luke Camilleri, Andreas Luyts, Nikolaos Dionelis, and Bertrand Le Saux, “PhilEO Bench: Evaluating Geo-Spatial Foundation Models,” arXiv:2401.04464, 2024.