Ans commited on
Commit
644b9df
1 Parent(s): fb8d22b

Updated timelog

Browse files
Files changed (1) hide show
  1. timelog.md +53 -7
timelog.md CHANGED
@@ -14,13 +14,59 @@
14
 
15
  ## Week 1
16
 
17
- ### 19 Oct 2019
18
 
19
- * *4 hours* Read the project guidance notes
20
- * *0.5 hour* Created GitLab repository and cloned the cookiecutter for the projects
21
- * *1 hour* Modified dissertation template, compiled
22
 
23
- ## 20 Oct 2019
24
 
25
- * *1 hour* meeting with supervisor
26
- * *2 hours* writing initial version of test harness
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
  ## Week 1
16
 
17
+ ### 21 Sep 2021
18
 
19
+ * *6 hours* Read through project proposals and rank best 8 and enter bids into system
 
 
20
 
21
+ ## Week 2
22
 
23
+ ### 28 Sep 2021
24
+
25
+ * *2 hours* Project Guidance live sessions
26
+ * *1 hour* Read the project guidance notes
27
+
28
+ ## 30 Sep 2021
29
+
30
+ * *0.5 hours* Initial meeting with supervisor
31
+
32
+ ## Week 3
33
+
34
+ ### 05 Oct 2021
35
+
36
+ * *3 hours* Read papers on text-generation
37
+ * *2 hours* Read blog posts to learn about language models, GPT-3, experiment with EleutherAI's GPT-J model.
38
+
39
+ ### 06 Oct 2021
40
+
41
+ * *0.5 hours* Meeting with supervisor
42
+
43
+ ## Week 4
44
+
45
+ ### 12 Oct 2021
46
+
47
+ * *6 hours* Got started with a colab notebook, learning how to use causal language models to generate text, used GPT-2 and learnt about top-k and top-p sampling, greedy search and beam search.
48
+
49
+ ### 13 Oct 2021
50
+
51
+ * *0.5 hours* Meeting with supervisor
52
+
53
+ ## Week 5
54
+
55
+ ### 19 Oct 2021
56
+
57
+ * *4 hours* Used RoBERTa, a masked language model, to fill in blank words in a sentence, given some starting words and ending words.
58
+
59
+ ### 20 Oct 2021
60
+
61
+ * *0.5 hours* Meeting with supervisor
62
+
63
+ ## Week 6
64
+
65
+ ### 26 Oct 2021
66
+
67
+ * *3 hours* Combined a causal language model and a masked language model, GPT-2 and RoBERTa, to generate the starts of sentences and fill in the rest until the end rhyming word.
68
+
69
+ ### 27 Oct 2021
70
+
71
+ * *0.5 hours* Meeting with supervisor
72
+ * *1 hour* Created GitHub repository and uploaded dissertation and project template from moodle