ideasbyjin
commited on
Commit
•
089ab81
1
Parent(s):
1128745
Slight edit
Browse files- LICENSE.md +1 -1
LICENSE.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
# AntiBERTa2 License
|
2 |
Version 1.0, December 2023 [Alchemab](http://alchemab.com)
|
3 |
|
4 |
-
AntiBERTa2 models are antibody-specific Large Language Models (LLM) developed by Alchemab Therapeutics Ltd. Currently AntiBERTa2 includes
|
5 |
|
6 |
Alchemab Therapeutics is making AntiBERTa2, specifically its parameter weights, available for use, reproduction and distribution under this modified version of the Apache 2.0 Licence.
|
7 |
|
|
|
1 |
# AntiBERTa2 License
|
2 |
Version 1.0, December 2023 [Alchemab](http://alchemab.com)
|
3 |
|
4 |
+
AntiBERTa2 models are antibody-specific Large Language Models (LLM) developed by Alchemab Therapeutics Ltd. Currently AntiBERTa2 includes two architectures referred to as AntiBERTa2 (202 M parameters) and AntiBERTa2-CSSP (202 M parameters). Based on the RoFormer LLM from natural language processing, AntiBERTa2 is pre-trained using MLM on 779.4 million unpaired and paired antibody sequences. AntiBERTa2-CSSP refers to a multimodal version of the AntiBERTa2 LLM that leverages the contrastive pre-training objective from the CLIP method; over 1000 antibody crystal structures from the Protein Data Bank were used. After pre-training, AntiBERTa2 develops a rich representation of antibody sequences that can be leveraged for an extensive range of tasks, including (without limitation) antigen binding prediction.
|
5 |
|
6 |
Alchemab Therapeutics is making AntiBERTa2, specifically its parameter weights, available for use, reproduction and distribution under this modified version of the Apache 2.0 Licence.
|
7 |
|