Licenses for Helsinki-NLP models
Author: okalldal
Pull request: no
Labels: name: model card

Some of the models in the hf-hub under the Helsinki-NLP repo are listed under the apache 2.0 license, but most are listed without a license.

Example of model without license:
https://huggingface.co/Helsinki-NLP/opus-mt-en-de

Only 371 models tagged with a license here:
https://huggingface.co/models?license=license:apache-2.0&sort=downloads&search=helsinki-nlp

Is this omission intentional or are all models in the repo actually intended to be apache licensed? If so would it be possible to update them with license info?

Comments:
@jorgtied might be able to answer this (and then we can programmatically update all models if needed)

Thanks!

(also cc @sshleifer and @patil-suraj for visibility)


They come with a CC-BY 4.0 license.
Jörg




> On 30. Aug 2021, at 13.16, Julien Chaumond ***@***.***> wrote:
> 
> 
> @jorgtied <https://github.com/jorgtied> might be able to answer this (and then we can programmatically update all models if needed)
> 
> Thanks!
> 
> (also cc @sshleifer <https://github.com/sshleifer> and @patil-suraj <https://github.com/patil-suraj> for visibility)
> 
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub <https://github.com/huggingface/transformers/issues/13328#issuecomment-908221978>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEWCPQVHTREFMSMDBTZPCLT7NK6NANCNFSM5DBQJLIQ>.
> Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. 
> 



Thanks a lot Jörg 🙏 . I'll update the repos programmatically tomorrow morning

Done.

For reference, here's the script I've run (depends on https://github.com/huggingface/huggingface_hub/pull/339 to be able to run it using `huggingface_hub`): https://gist.github.com/julien-c/b2dcde5df5d5e41ad7c4b594cb54aba3

And here's a partial list of the generated commits (full list attached to the gist):

```
https://huggingface.co/Helsinki-NLP/opus-mt-bg-en/commit/3a34359f5781368c7748219c2868ffd065f24df0
https://huggingface.co/Helsinki-NLP/opus-mt-bg-fi/commit/04d4dd3690cc730690da31b45745fb3f74198b0f
https://huggingface.co/Helsinki-NLP/opus-mt-bg-sv/commit/7f2c7cc3887492a080441266c63b20fd13497e56
https://huggingface.co/Helsinki-NLP/opus-mt-bi-en/commit/feb365f89ee1f47cad4f1581896b80ae88978983
https://huggingface.co/Helsinki-NLP/opus-mt-bi-es/commit/40001c75cc73df30ac2ffe45d8c3f224ee17781b
https://huggingface.co/Helsinki-NLP/opus-mt-bi-fr/commit/31712329599ad7b50590cd35299ccc8d94029122
https://huggingface.co/Helsinki-NLP/opus-mt-bi-sv/commit/fa443f611486bd359dee28a2ef896a03ca81e515
https://huggingface.co/Helsinki-NLP/opus-mt-bzs-en/commit/4a0238e6463445a99590c0abe7aed5f2f95e064d
https://huggingface.co/Helsinki-NLP/opus-mt-bzs-es/commit/b03449222edb29b8497af1df03c30782995912f5
https://huggingface.co/Helsinki-NLP/opus-mt-bzs-fi/commit/26a623904cfb745bdc48f4e62f4de8ec0f0f0bbb
https://huggingface.co/Helsinki-NLP/opus-mt-bzs-fr/commit/5f69cdba6de378f61042d90ed0a19f3047837ea1
https://huggingface.co/Helsinki-NLP/opus-mt-bzs-sv/commit/2a12941aeaeaa78979240cfcb1d63e44958af76f
https://huggingface.co/Helsinki-NLP/opus-mt-ca-en/commit/22113f5e0e8e89677d6e0142e55c85402eecb455
https://huggingface.co/Helsinki-NLP/opus-mt-ca-es/commit/3b93f0ccce95f7d8c7a78d56ec5c658271f6d244
https://huggingface.co/Helsinki-NLP/opus-mt-ceb-es/commit/94ff5e6902541d95fc1890e7e5e185477d922271
https://huggingface.co/Helsinki-NLP/opus-mt-ceb-fi/commit/8c5cdaa45a8ef959061c6d97a7f118e2714725bc
https://huggingface.co/Helsinki-NLP/opus-mt-ceb-fr/commit/90d773c1774988007f9fd8f44477de8d5ee310b6
https://huggingface.co/Helsinki-NLP/opus-mt-ceb-sv/commit/bf1810fb698cbeb2a7beeecb96917557ece3158f
https://huggingface.co/Helsinki-NLP/opus-mt-chk-en/commit/d9a7fad4fdc70b734457a5eee20835d8899e7415
https://huggingface.co/Helsinki-NLP/opus-mt-chk-es/commit/c41790360ecb70331ba71c881db1c592b0923502
https://huggingface.co/Helsinki-NLP/opus-mt-chk-fr/commit/6db3456d236063ccbb97abdea52dc574da37a898
https://huggingface.co/Helsinki-NLP/opus-mt-chk-sv/commit/de1bf0196adc388148bb52c5388fd795c46191b6
https://huggingface.co/Helsinki-NLP/opus-mt-crs-de/commit/f0552c0fcef8dc8b03acc5ecf9c170a3a9356ca1
https://huggingface.co/Helsinki-NLP/opus-mt-crs-en/commit/7ee4bb979dd28886b7d98f890298c4548e84a847
https://huggingface.co/Helsinki-NLP/opus-mt-crs-es/commit/808d78b9c72092991bba047542192f26c3bff3b8
https://huggingface.co/Helsinki-NLP/opus-mt-crs-fi/commit/e61325e6904fe87fbad3e6d978dca63fb4e766ba
https://huggingface.co/Helsinki-NLP/opus-mt-crs-fr/commit/341ed6222bcb84709acf9b8a3d5d57991b350c5e
https://huggingface.co/Helsinki-NLP/opus-mt-crs-sv/commit/a338a7e5ef9b876f1edc63b0af6c6cd11e6a7611
https://huggingface.co/Helsinki-NLP/opus-mt-cs-de/commit/f5a1b1443dc5381df3a0a83d790b3c2eb16cf811
https://huggingface.co/Helsinki-NLP/opus-mt-cs-en/commit/186ab5dff3e18ca970a492525c0ca4b398d525ab
https://huggingface.co/Helsinki-NLP/opus-mt-cs-fi/commit/d60a357cfb2c4d1df38b43f2fafe34dbff0199cf
https://huggingface.co/Helsinki-NLP/opus-mt-cs-fr/commit/3040852ec5404c1da928602fa1ec636b6ddf9a2e
https://huggingface.co/Helsinki-NLP/opus-mt-cs-sv/commit/ab967fe66d1c0d4f9403ae0b4c97c06ae8947b89
https://huggingface.co/Helsinki-NLP/opus-mt-csg-es/commit/9742b7a5ed07cb69c4051567686b2e1ace50b061
https://huggingface.co/Helsinki-NLP/opus-mt-csn-es/commit/c3086bbf7d9101947a5a07d286cb9ccc533f9e0a
https://huggingface.co/Helsinki-NLP/opus-mt-cy-en/commit/775c85089bc7a55c8203bff544e9fa34cd4ba7ca
https://huggingface.co/Helsinki-NLP/opus-mt-da-de/commit/2e4d10f7054f579178b167e5082b0e57726eee44
https://huggingface.co/Helsinki-NLP/opus-mt-da-en/commit/8971eb3839ec41bddd060128b9b83038bb43fd96
https://huggingface.co/Helsinki-NLP/opus-mt-da-es/commit/59b50e55d16babe69b0facb1fb1c4dfb175328fe
https://huggingface.co/Helsinki-NLP/opus-mt-da-fi/commit/a2e614cb32e2b0fa09c5c1dcaba8122d9d647b18
https://huggingface.co/Helsinki-NLP/opus-mt-da-fr/commit/186e4c938bc1744a9ddbd67073fe572c93a494c8
https://huggingface.co/Helsinki-NLP/opus-mt-de-ZH/commit/93d4bc065a572a35ab1f1110ffeccc9740444a42
https://huggingface.co/Helsinki-NLP/opus-mt-de-ase/commit/09e461fdf799287e13c7c48df0573fd89273b1bd
https://huggingface.co/Helsinki-NLP/opus-mt-de-bcl/commit/628737ef8907e7d2db7989660f413420cfad41f5
https://huggingface.co/Helsinki-NLP/opus-mt-de-bi/commit/7c40aed9a4611cec93aa9560f2bb99e49e895789
https://huggingface.co/Helsinki-NLP/opus-mt-de-bzs/commit/30ed515b4d391e1f98cefdbf5f6fcc340c979fce
https://huggingface.co/Helsinki-NLP/opus-mt-de-crs/commit/b9de144126655b973cd8cf74a5651ac999e551a2
https://huggingface.co/Helsinki-NLP/opus-mt-de-cs/commit/683666e07ca027d76af9ac23c0902b29084a0d18
https://huggingface.co/Helsinki-NLP/opus-mt-de-da/commit/bccfbee95d55ba1333fd447f67574453eba5d948
https://huggingface.co/Helsinki-NLP/opus-mt-de-de/commit/7be6c82bcda2cf76f48ba1f730baeeebcbcb172d
https://huggingface.co/Helsinki-NLP/opus-mt-de-ee/commit/42218c447d3da4a8836adb6de710d06bbad480c9
https://huggingface.co/Helsinki-NLP/opus-mt-de-efi/commit/1309ccb2f74acba991a654adf4ff1363a577d51b
https://huggingface.co/Helsinki-NLP/opus-mt-de-el/commit/ad3da773c26cf72780d46b4a75333226a19760e4
https://huggingface.co/Helsinki-NLP/opus-mt-de-en/commit/6137149949ac01d19d8eeef6e35d32221dabc8e4
https://huggingface.co/Helsinki-NLP/opus-mt-de-eo/commit/9188e5326cba934d553fcb0150a9e88de140a286
https://huggingface.co/Helsinki-NLP/opus-mt-de-es/commit/d6bff091731341b977e4ca7294d2c309a2ca11e4
https://huggingface.co/Helsinki-NLP/opus-mt-de-et/commit/55157cd448f864a87992b80aef23f95546a0280c
https://huggingface.co/Helsinki-NLP/opus-mt-de-fi/commit/bbd50eeefdc1e26d75f6a806495192b55878c04a
https://huggingface.co/Helsinki-NLP/opus-mt-de-fj/commit/596580a8225fb340357d25cd38639fed5d662681
https://huggingface.co/Helsinki-NLP/opus-mt-de-fr/commit/6aa8c4011488513f5575b235ce75d6d795d90b35
https://huggingface.co/Helsinki-NLP/opus-mt-de-gaa/commit/0722f96d5ce2e9fd6b2e0df3987105a78d062d1c
https://huggingface.co/Helsinki-NLP/opus-mt-de-gil/commit/56bb25bf50c7b8268c9fd1ec8f8124e54631af59
https://huggingface.co/Helsinki-NLP/opus-mt-de-guw/commit/7a441fe0e9e7c4c430889b46b3b4541005c93bb1
https://huggingface.co/Helsinki-NLP/opus-mt-de-ha/commit/5a241c2d7ce3f36d42b7bbd7f563bd0da651d480
https://huggingface.co/Helsinki-NLP/opus-mt-de-he/commit/44d42278e67bf34bd1c0a8dcca06c6525eca6263
https://huggingface.co/Helsinki-NLP/opus-mt-de-hil/commit/4f0571df9d70e36af0435f1368a03cd059750c40
https://huggingface.co/Helsinki-NLP/opus-mt-de-ho/commit/6f07189ef39e3e609a24c45936c40e30fd6b3ef8
https://huggingface.co/Helsinki-NLP/opus-mt-de-hr/commit/d1b7e5205290af5c36e8be8cd6d73f6b5d9bba5f
https://huggingface.co/Helsinki-NLP/opus-mt-de-ht/commit/2d296463f4735961ca4512271b415aacf7c0ba91
https://huggingface.co/Helsinki-NLP/opus-mt-de-hu/commit/4b30440320ea86d33b6927fe70c46e20f671da86
https://huggingface.co/Helsinki-NLP/opus-mt-de-ig/commit/862152c08618d17ff651fc7df9145d81519ba9f7
https://huggingface.co/Helsinki-NLP/opus-mt-de-ilo/commit/e9260adbaa77c85f5a0203460399c1cec12357c1
https://huggingface.co/Helsinki-NLP/opus-mt-de-iso/commit/d3d1caff0521142085ee7faa07112ce593803734
https://huggingface.co/Helsinki-NLP/opus-mt-de-it/commit/cd2319a082a7be0dd471fe62701ae557a71833c2
https://huggingface.co/Helsinki-NLP/opus-mt-de-kg/commit/495d68528e086b0ccea38761513241152e4f217f
https://huggingface.co/Helsinki-NLP/opus-mt-de-ln/commit/05dd393385fb99c42d5849c22cef67931922eff3
https://huggingface.co/Helsinki-NLP/opus-mt-de-loz/commit/efc9fe11206c281704056c9c3eda0b42f1cf43a0
https://huggingface.co/Helsinki-NLP/opus-mt-de-lt/commit/e0105109d696baf37e2a4cca511a46f59fa97707
https://huggingface.co/Helsinki-NLP/opus-mt-de-lua/commit/319b94b75439b497c0860a3fc80a34ecacb597a0
https://huggingface.co/Helsinki-NLP/opus-mt-de-mt/commit/0d71c2c09e3838d7276288da102f7e66d2d24032
https://huggingface.co/Helsinki-NLP/opus-mt-de-niu/commit/6b15b26f7d7752bfde0368809479c544880174cd
https://huggingface.co/Helsinki-NLP/opus-mt-de-nl/commit/da037ec1ad70f9d79735c287d418c00158b55b68
https://huggingface.co/Helsinki-NLP/opus-mt-de-nso/commit/fbd9a40fa66f610b52855ad16263d4ea32c8bd7c
https://huggingface.co/Helsinki-NLP/opus-mt-de-ny/commit/595549133dfde470a3ea04e93674ff1c90c5ac5a
https://huggingface.co/Helsinki-NLP/opus-mt-de-pag/commit/f03679f6d038388c5a0a40918acc4bf6406cac28
https://huggingface.co/Helsinki-NLP/opus-mt-de-pap/commit/6c57622b7e815f9e1cb24f6e1f9a09b58627f0b7
https://huggingface.co/Helsinki-NLP/opus-mt-de-pis/commit/ddfb8177ff0559adc697171c2c4c7704921bd4ec
https://huggingface.co/Helsinki-NLP/opus-mt-de-pl/commit/67458bb97566391315397d8e0aa5f14f774bd238
https://huggingface.co/Helsinki-NLP/opus-mt-de-pon/commit/d18f29c5ef79abbca40d53e34b94c8514ffd6235
https://huggingface.co/Helsinki-NLP/opus-mt-ee-de/commit/5e01b793901fec6acbcaf6b35e9e0873d7190147
https://huggingface.co/Helsinki-NLP/opus-mt-ee-en/commit/a69e3d990dc8b84d8d727b9502c20511a50233ed
https://huggingface.co/Helsinki-NLP/opus-mt-ee-es/commit/976bee3eb2616b35a55d6e6467ca2d211ba68d49
https://huggingface.co/Helsinki-NLP/opus-mt-ee-fi/commit/8547cfc9f2c5ef75f00c78ef563eef59fc0204ee
https://huggingface.co/Helsinki-NLP/opus-mt-ee-fr/commit/066e2a847a6098c2a999d6db7a1f50b878578c8e
https://huggingface.co/Helsinki-NLP/opus-mt-ee-sv/commit/8170bc4af3be1e3633e37ef4180cada5eb177b2c
https://huggingface.co/Helsinki-NLP/opus-mt-efi-de/commit/cedf2694630c1ee2ea1d75dffead02c4dc49ef80
https://huggingface.co/Helsinki-NLP/opus-mt-efi-en/commit/0bf437954f943da3d49a172b6f91aa7157c3525a
https://huggingface.co/Helsinki-NLP/opus-mt-efi-fi/commit/02877c2ef68a205047cde71b4b376ffcc565e4a7
https://huggingface.co/Helsinki-NLP/opus-mt-efi-fr/commit/7b528531e45c04716015e7c211ef2b74817ff438
https://huggingface.co/Helsinki-NLP/opus-mt-efi-sv/commit/c02cd07b017c7c71d4583dbd6050dfee383a1cf0
https://huggingface.co/Helsinki-NLP/opus-mt-el-fi/commit/aef52d8c3cc2129847cf9ea84c62a5e7b9bb41bc
https://huggingface.co/Helsinki-NLP/opus-mt-el-fr/commit/b00ba91c42b2f20768228b179f01274048158001
https://huggingface.co/Helsinki-NLP/opus-mt-el-sv/commit/e8894cf2f5713e1cc68fe7710636ecc4b4dc99d7
https://huggingface.co/Helsinki-NLP/opus-mt-en-CELTIC/commit/69fe75e42d848a1b30f968800ff94783e3ed8fe2
https://huggingface.co/Helsinki-NLP/opus-mt-en-ROMANCE/commit/92870a2f094c444064c7a568c25eef6971e07b03
https://huggingface.co/Helsinki-NLP/opus-mt-en-af/commit/c6a79302395db2b59af8b15f4016081a66095ace
https://huggingface.co/Helsinki-NLP/opus-mt-en-bcl/commit/fdda7e146d903da0f4da8895800c52bdcfa07ecc
https://huggingface.co/Helsinki-NLP/opus-mt-en-bem/commit/7d0c704d934f400158d645345a7ed27c6cfe73e8
https://huggingface.co/Helsinki-NLP/opus-mt-en-ber/commit/cad15de24b5374102d6dd95619d0c4011102dcce
https://huggingface.co/Helsinki-NLP/opus-mt-en-bi/commit/b3e9ed52697fffab06a733a23c37d843a3464976
https://huggingface.co/Helsinki-NLP/opus-mt-en-bzs/commit/2b7c7d345202d17dd7f42850eae846e4d11b6fda
https://huggingface.co/Helsinki-NLP/opus-mt-en-ca/commit/81d80b5921b66885e45c3b27615752da4b511b40
https://huggingface.co/Helsinki-NLP/opus-mt-en-ceb/commit/a5e0a21b4e9db37945be9cd5977573b53cd95999
https://huggingface.co/Helsinki-NLP/opus-mt-en-chk/commit/a57e025c3f8a7a9b20968190b6a6db234ef1541a
https://huggingface.co/Helsinki-NLP/opus-mt-en-crs/commit/1f25af1f9d1c0680005a9f0d16ed8bb412784c32
https://huggingface.co/Helsinki-NLP/opus-mt-en-cs/commit/7cba4a7e3daff13c48fc2fcd740ef0711b1dd075
https://huggingface.co/Helsinki-NLP/opus-mt-en-cy/commit/038aee0304224b119582e0258c0dff2bc1c1c411
https://huggingface.co/Helsinki-NLP/opus-mt-en-da/commit/9786126ba34f1f86636af779ef13557bd9d1b246
https://huggingface.co/Helsinki-NLP/opus-mt-en-de/commit/6c00b328d3da7183582a4928b638b24a4a14a79f
https://huggingface.co/Helsinki-NLP/opus-mt-en-ee/commit/45d6ef20f2aac6de3ad001d7452ff5243f25f219
https://huggingface.co/Helsinki-NLP/opus-mt-en-efi/commit/08b5f78e0bb66e8e1940fe1eb976a5b9de276f84
https://huggingface.co/Helsinki-NLP/opus-mt-en-el/commit/cd8ab0896f1d0598007ba5266a0a30884fed71de
https://huggingface.co/Helsinki-NLP/opus-mt-en-eo/commit/20a8920034dfbb6b2e5909f5065a32d6b1b5990b
https://huggingface.co/Helsinki-NLP/opus-mt-en-et/commit/f696ce2db3f802cf4dd723ea97b2af1eda90c7e9
https://huggingface.co/Helsinki-NLP/opus-mt-en-fi/commit/627fe90df5c335be61521cd89c68f62e2bdce050
https://huggingface.co/Helsinki-NLP/opus-mt-en-fj/commit/2c98ee541817946993595aa514f12804b6c95efc
https://huggingface.co/Helsinki-NLP/opus-mt-en-fr/commit/a8fbc1c711cb6263e8a20c5229b210cc05c57ff0
https://huggingface.co/Helsinki-NLP/opus-mt-en-gaa/commit/2f75e3d8bc190f8e0e412beecf00e564c40e33c4
```

Looking great! Thank you for the quick resolution of this!

I have a doubt, on the [opus-MT github page](https://github.com/Helsinki-NLP/OPUS-MT-train/tree/master) it says that all pretrained models are under the cc by 4.0 license, but on hugging face many opus-MT models have apache 2.0 license, for example, [this model](https://huggingface.co/Helsinki-NLP/opus-mt-it-fr) on hugging face has the apache 2.0 license, while downloading it from the opus-MT github page ([here](https://github.com/Helsinki-NLP/OPUS-MT-train/tree/master/models/it-fr)) it has the cc by 4.0 license among the files, is this an error or did I miss something?

Hi @niedev, thanks for raising this! Could you open a discussion on the respective checkpoint pages on the hub?