Update README.md
Browse files
README.md
CHANGED
@@ -10,9 +10,9 @@ library_name: timm
|
|
10 |
|
11 |
# Model Card for Model ID
|
12 |
|
13 |
-
Based on
|
14 |
|
15 |
-
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1)
|
16 |
|
17 |
|
18 |
|
@@ -20,17 +20,14 @@ This modelcard aims to be a base template for new models. It has been generated
|
|
20 |
|
21 |
### Model Description
|
22 |
|
23 |
-
Instead of the `bottleneck` block of ResNet50 which consists of 1x1, 3x3, 1x1 in succession,
|
24 |
|
25 |
|
26 |
|
27 |
- **Developed by:** Yao Liu 刘杳
|
28 |
-
- **
|
29 |
-
- **Shared by [optional]:** [More Information Needed]
|
30 |
-
- **Model type:** [More Information Needed]
|
31 |
-
- **Language(s) (NLP):** [More Information Needed]
|
32 |
- **License:** [More Information Needed]
|
33 |
-
- **Finetuned from model [optional]:**
|
34 |
|
35 |
### Model Sources [optional]
|
36 |
|
@@ -40,40 +37,6 @@ Instead of the `bottleneck` block of ResNet50 which consists of 1x1, 3x3, 1x1 in
|
|
40 |
- **Paper [optional]:** [A Novel ConvNet Architecture with a Continuous Symmetry](https://arxiv.org/abs/2308.01621)
|
41 |
- **Demo [optional]:** [More Information Needed]
|
42 |
|
43 |
-
## Uses
|
44 |
-
|
45 |
-
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
46 |
-
|
47 |
-
### Direct Use
|
48 |
-
|
49 |
-
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
50 |
-
|
51 |
-
[More Information Needed]
|
52 |
-
|
53 |
-
### Downstream Use [optional]
|
54 |
-
|
55 |
-
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
56 |
-
|
57 |
-
[More Information Needed]
|
58 |
-
|
59 |
-
### Out-of-Scope Use
|
60 |
-
|
61 |
-
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
62 |
-
|
63 |
-
[More Information Needed]
|
64 |
-
|
65 |
-
## Bias, Risks, and Limitations
|
66 |
-
|
67 |
-
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
68 |
-
|
69 |
-
[More Information Needed]
|
70 |
-
|
71 |
-
### Recommendations
|
72 |
-
|
73 |
-
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
74 |
-
|
75 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
76 |
-
|
77 |
## How to Get Started with the Model
|
78 |
|
79 |
Use the code below to get started with the model.
|
@@ -82,15 +45,19 @@ Use the code below to get started with the model.
|
|
82 |
|
83 |
## Training Details
|
84 |
|
85 |
-
### Training Data
|
86 |
|
87 |
-
|
88 |
|
89 |
[More Information Needed]
|
90 |
|
91 |
### Training Procedure
|
92 |
|
93 |
-
|
|
|
|
|
|
|
|
|
94 |
|
95 |
#### Preprocessing [optional]
|
96 |
|
@@ -105,35 +72,9 @@ Use the code below to get started with the model.
|
|
105 |
|
106 |
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
107 |
|
108 |
-
[More Information Needed]
|
109 |
-
|
110 |
-
## Evaluation
|
111 |
-
|
112 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
113 |
-
|
114 |
-
### Testing Data, Factors & Metrics
|
115 |
-
|
116 |
-
#### Testing Data
|
117 |
-
|
118 |
-
<!-- This should link to a Dataset Card if possible. -->
|
119 |
-
|
120 |
-
[More Information Needed]
|
121 |
-
|
122 |
-
#### Factors
|
123 |
-
|
124 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
125 |
-
|
126 |
-
[More Information Needed]
|
127 |
-
|
128 |
-
#### Metrics
|
129 |
-
|
130 |
-
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
131 |
-
|
132 |
-
[More Information Needed]
|
133 |
-
|
134 |
### Results
|
135 |
|
136 |
-
|
137 |
|
138 |
#### Summary
|
139 |
|
@@ -145,18 +86,6 @@ Use the code below to get started with the model.
|
|
145 |
|
146 |
[More Information Needed]
|
147 |
|
148 |
-
## Environmental Impact
|
149 |
-
|
150 |
-
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
151 |
-
|
152 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
153 |
-
|
154 |
-
- **Hardware Type:** [More Information Needed]
|
155 |
-
- **Hours used:** [More Information Needed]
|
156 |
-
- **Cloud Provider:** [More Information Needed]
|
157 |
-
- **Compute Region:** [More Information Needed]
|
158 |
-
- **Carbon Emitted:** [More Information Needed]
|
159 |
-
|
160 |
## Technical Specifications [optional]
|
161 |
|
162 |
### Model Architecture and Objective
|
@@ -169,7 +98,7 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
169 |
|
170 |
#### Hardware
|
171 |
|
172 |
-
|
173 |
|
174 |
#### Software
|
175 |
|
|
|
10 |
|
11 |
# Model Card for Model ID
|
12 |
|
13 |
+
Based on quasi-linear hyperbolic systems of PDEs, the QLNet enters an uncharted water of the model space for ConvNets that uses multiplication (of same-sized tensors) instead of ReLU as the nonlinearity. It achieves comparable accuracy as ResNet50 on ImageNet-1k, demonstrating that it has the same level of capacity/expressivity, and deserves more study (hyper-paremeter tuning, optimizer, etc.) that I alone am not able to do.
|
14 |
|
15 |
+
*This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).*
|
16 |
|
17 |
|
18 |
|
|
|
20 |
|
21 |
### Model Description
|
22 |
|
23 |
+
Instead of the `bottleneck` block of ResNet50 which consists of 1x1, 3x3, 1x1 in succession, this simplest version of QLNet does a 1x1, splits into two equal halves and **multiplies** them, then applies a 3x3 (depthwise), and a 1x1, all *without* activation functions except at the end of the block, where a *radial activation function* that we call `hardball` is applied.
|
24 |
|
25 |
|
26 |
|
27 |
- **Developed by:** Yao Liu 刘杳
|
28 |
+
- **Model type:** Convolutiona Neural Network (ConvNet)
|
|
|
|
|
|
|
29 |
- **License:** [More Information Needed]
|
30 |
+
- **Finetuned from model [optional]:** *from scratch*
|
31 |
|
32 |
### Model Sources [optional]
|
33 |
|
|
|
37 |
- **Paper [optional]:** [A Novel ConvNet Architecture with a Continuous Symmetry](https://arxiv.org/abs/2308.01621)
|
38 |
- **Demo [optional]:** [More Information Needed]
|
39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
## How to Get Started with the Model
|
41 |
|
42 |
Use the code below to get started with the model.
|
|
|
45 |
|
46 |
## Training Details
|
47 |
|
48 |
+
### Training and Testing Data
|
49 |
|
50 |
+
ImageNet-1k
|
51 |
|
52 |
[More Information Needed]
|
53 |
|
54 |
### Training Procedure
|
55 |
|
56 |
+
We use the training script in `timm`
|
57 |
+
|
58 |
+
```
|
59 |
+
python3 train.py ../datasets/imagenet/ --model resnet50 --num-classes 1000 --lr 0.1 --warmup-epochs 5 --epochs 240 --weight-decay 1e-4 --sched cosine --reprob 0.4 --recount 3 --remode pixel --aa rand-m7-mstd0.5-inc1 -b 192 -j 6 --amp --dist-bn reduce
|
60 |
+
```
|
61 |
|
62 |
#### Preprocessing [optional]
|
63 |
|
|
|
72 |
|
73 |
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
74 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
75 |
### Results
|
76 |
|
77 |
+
top1 acc = 78.40
|
78 |
|
79 |
#### Summary
|
80 |
|
|
|
86 |
|
87 |
[More Information Needed]
|
88 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
89 |
## Technical Specifications [optional]
|
90 |
|
91 |
### Model Architecture and Objective
|
|
|
98 |
|
99 |
#### Hardware
|
100 |
|
101 |
+
single GPU :(
|
102 |
|
103 |
#### Software
|
104 |
|