Updated timelog

timelog.md

@@ -14,13 +14,59 @@
 
 ## Week 1
 
-### 19 Oct 2019
+### 21 Sep 2021
 
-* *4 hours* Read the project guidance notes
-* *0.5 hour* Created GitLab repository and cloned the cookiecutter for the projects
-* *1 hour* Modified dissertation template, compiled  
+* *6 hours* Read through project proposals and rank best 8 and enter bids into system
 
-## 20 Oct 2019
+## Week 2
 
-* *1 hour* meeting with supervisor
-* *2 hours* writing initial version of test harness
+### 28 Sep 2021
+
+* *2 hours* Project Guidance live sessions
+* *1 hour* Read the project guidance notes
+
+## 30 Sep 2021
+
+* *0.5 hours* Initial meeting with supervisor
+
+## Week 3
+
+### 05 Oct 2021
+
+* *3 hours* Read papers on text-generation
+* *2 hours* Read blog posts to learn about language models, GPT-3, experiment with EleutherAI's GPT-J model.
+
+### 06 Oct 2021
+
+* *0.5 hours* Meeting with supervisor
+
+## Week 4
+
+### 12 Oct 2021
+
+* *6 hours* Got started with a colab notebook, learning how to use causal language models to generate text, used GPT-2 and learnt about top-k and top-p sampling, greedy search and beam search.
+
+### 13 Oct 2021
+
+* *0.5 hours* Meeting with supervisor
+
+## Week 5
+
+### 19 Oct 2021
+
+* *4 hours* Used RoBERTa, a masked language model, to fill in blank words in a sentence, given some starting words and ending words.
+
+### 20 Oct 2021
+
+* *0.5 hours* Meeting with supervisor
+
+## Week 6
+
+### 26 Oct 2021
+
+* *3 hours* Combined a causal language model and a masked language model, GPT-2 and RoBERTa, to generate the starts of sentences and fill in the rest until the end rhyming word.
+
+### 27 Oct 2021
+
+* *0.5 hours* Meeting with supervisor
+* *1 hour* Created GitHub repository and uploaded dissertation and project template from moodle