reshinth.adith
commited on
Commit
•
fffa4f0
1
Parent(s):
23b8ab8
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
# GlassBERTa
|
| 3 |
+
## Language Modelling as Unsupervised Pre-Training for Glass Alloys
|
| 4 |
+
### Abstract:
|
| 5 |
+
Alloy Property Prediction is a task under the sub field of Alloy Material Science wherein Machine Learning has been applied rigorously. This is modelled as a Supervised Task wherein AlloyComposition is provided for the Model to predict a desired property. Efficiency of tasks such as AlloyProperty Prediction, Alloy Synthesis can be modelled additionally with an Unsupervised Pre-trainingTask. We describe the idea of Pre-training using Language Modelling kind of approach interms of Alloy Compositions.We specifically inspect that random masking proposed in is not suitable for modelling Alloys. We further go on proposing two types of masking strategies that are used to train GlassBERTa to encompass the properties of an Alloy Composition. The results suggest that Pre-training is an important field of direction in this field of research for further improvement.
|
| 6 |
+
### Authors:
|
| 7 |
+
Reshinth Adithyan, Aditya TS, Roakesh, Jothikrishna, Kalaiselvan
|