macedonizer commited on
Commit
14d9abd
1 Parent(s): a755133

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -11
README.md CHANGED
@@ -11,17 +11,12 @@ datasets:
11
  # blaze-koneski
12
  GPT-2 type of model. We finetuned macedonizer/mk-gpt-2 with Blaze Koneski's poetry.
13
 
14
- ## Model description
15
- mk-gpt2 is a transformers model pretrained on a very large corpus of Macedonian data in a self-supervised fashion. This
16
- means it was pretrained on the raw texts only, with no humans labelling them in any way (which is why it can use lots
17
- of publicly available data) with an automatic process to generate inputs and labels from those texts. More precisely,
18
- it was trained to guess the next word in sentences.
19
- More precisely, inputs are sequences of continuous text of a certain length and the targets are the same sequence,
20
- shifted one token (word or piece of word) to the right. The model uses internally a mask-mechanism to make sure the
21
- predictions for the token `i` only uses the inputs from `1` to `i` but not the future tokens.
22
- This way, the model learns an inner representation of the Macedonian language that can then be used to extract features
23
- useful for downstream tasks. The model is best at what it was pretrained for however, which is generating texts from a
24
- prompt.
25
 
26
  ### How to use
27
  Here is how to use this model to get the features of a given text in PyTorch:
11
  # blaze-koneski
12
  GPT-2 type of model. We finetuned macedonizer/mk-gpt-2 with Blaze Koneski's poetry.
13
 
14
+ ## About Blaze Koneski
15
+ Born in a village near Prilep in 1921. Studied philology at Skopje University and worked there as a professor. Was the first chairman of the Macedonian Academy of Sciences and Arts, corresponding member of the Yugoslav Academy of Sciences and Arts, as well as of the Serbian and Slovene Academies, and honorary doctor of the Universities of Chicago and Krakow.
16
+
17
+ Wrote poetry, short stories, and essays, as well as scholarly works, many of them on the Macedonian language. Editor of the Dictionarv of the Macedonian Language, translator of Heine and Shakespeare. His works have been translated into Serbian, Croatian, Slovene, Albanian, Turkish, Hungarian, French, Russian, Italian, Greek, Polish, Romanian, German, and English.
18
+
19
+ Winner of numerous prizes, including the Golden Wreath of the Struga Poetry Evenings.
 
 
 
 
 
20
 
21
  ### How to use
22
  Here is how to use this model to get the features of a given text in PyTorch: