Update README.md

#2
by reach-vb HF staff - opened
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -22,6 +22,28 @@ The model is trained using a "bipartite matching loss": one compares the predict
22
 
23
  You can use the raw model for object detection. See the [model hub](https://huggingface.co/models?search=facebook/detr) to look for all available DETR models.
24
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  ## Download
26
 
27
  Install `huggingface-hub`
 
22
 
23
  You can use the raw model for object detection. See the [model hub](https://huggingface.co/models?search=facebook/detr) to look for all available DETR models.
24
 
25
+ ## Evaluation - Variants
26
+
27
+ | Variant | Parameters | Size (MB) | Weight Precision | Act. Precision | IoU | Pixel accuracy |
28
+ |-------------------------------------------------------------------------------------------------------|-----------:|----------:|------------------|----------------|------:|---------------:|
29
+ | [facebook/detr-resnet-50-panoptic (PyTorch)](https://huggingface.co/facebook/detr-resnet-50-panoptic) | 43M | 172 | Float32 | Float32 | 0.393 | 0.746 |
30
+ | [DETRResnet50SemanticSegmentationF32](DETRResnet50SemanticSegmentationF32.mlpackage) | 43M | 171 | Float32 | Float32 | 0.393 | 0.746 |
31
+ | [DETRResnet50SemanticSegmentationF16](DETRResnet50SemanticSegmentationF16.mlpackage) | 43M | 86 | Float16 | Float16 | 0.395 | 0.746 |
32
+
33
+ IoU and Pixel accuracy measured on 512 images from the COCO dataset. The ground truth labels were extracted from the panoptic segmentation annotations, transformed to semantic segmentation masks. Input images were resized so that the smaller edge equals 448, then center-cropped.
34
+
35
+ ## Evaluation - Inference time
36
+
37
+ The following results refer to DETRResnet50SemanticSegmentationF16. The compute units for MacBook Pro (M1 Max) were manually selected to "CPU and Neural Engine".
38
+
39
+ | Device | OS | Inference time (ms) | Dominant compute unit |
40
+ | -------------------- | ---- | ------------------: | --------------------- |
41
+ | iPhone 14 | 17.5 | | Neural Engine |
42
+ | iPhone 14 Pro Max | 17.5 | | Neural Engine |
43
+ | iPhone 15 | 17.0 | | Neural Engine |
44
+ | iPhone 15 Pro Max | 17.5 | 40 | Neural Engine |
45
+ | MacBook Pro (M1 Max) | 14.5 | 43 | Neural Engine |
46
+
47
  ## Download
48
 
49
  Install `huggingface-hub`