Commit
·
e7f3407
1
Parent(s):
dc6bb12
add lighthubert profiling results
Browse files- README.md +14 -0
- lighthubert_profile.zip +3 -0
README.md
CHANGED
@@ -65,6 +65,20 @@ hs = model.extract_features(wav_input_16khz, ret_hs=True)[0]
|
|
65 |
print(f"Representation at bottom hidden states: {torch.allclose(rep, hs[-1])}")
|
66 |
```
|
67 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
68 |
### Reference
|
69 |
|
70 |
If you find our work is useful in your research, please cite the following paper:
|
|
|
65 |
print(f"Representation at bottom hidden states: {torch.allclose(rep, hs[-1])}")
|
66 |
```
|
67 |
|
68 |
+
### Profiling LightHuBERT
|
69 |
+
|
70 |
+
As mentioned in [Profiling Tool for SLT2022 SUPERB Challenge](https://github.com/B06901052/DeepSpeed/tree/superb-challenge), we profiling the `lighthubert` in s3prl.
|
71 |
+
|
72 |
+
```sh
|
73 |
+
cd DeepSpeed
|
74 |
+
# lighthubert_small
|
75 |
+
python testing/s3prl_profiling_test.py -u lighthubert_small --libri_root "libri_root"
|
76 |
+
# lighthubert_base
|
77 |
+
python testing/s3prl_profiling_test.py -u lighthubert_base --libri_root "libri_root"
|
78 |
+
# lighthubert_stage1
|
79 |
+
python testing/s3prl_profiling_test.py -u lighthubert_stage1 --libri_root "libri_root"
|
80 |
+
```
|
81 |
+
|
82 |
### Reference
|
83 |
|
84 |
If you find our work is useful in your research, please cite the following paper:
|
lighthubert_profile.zip
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:783c7cb607506d889f85e176b3ad21859396d984ada3ad11d85036e491b7e079
|
3 |
+
size 46849
|