Spaces:
Sleeping
Sleeping
Ans
commited on
Commit
•
644b9df
1
Parent(s):
fb8d22b
Updated timelog
Browse files- timelog.md +53 -7
timelog.md
CHANGED
@@ -14,13 +14,59 @@
|
|
14 |
|
15 |
## Week 1
|
16 |
|
17 |
-
###
|
18 |
|
19 |
-
* *
|
20 |
-
* *0.5 hour* Created GitLab repository and cloned the cookiecutter for the projects
|
21 |
-
* *1 hour* Modified dissertation template, compiled
|
22 |
|
23 |
-
##
|
24 |
|
25 |
-
|
26 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
14 |
|
15 |
## Week 1
|
16 |
|
17 |
+
### 21 Sep 2021
|
18 |
|
19 |
+
* *6 hours* Read through project proposals and rank best 8 and enter bids into system
|
|
|
|
|
20 |
|
21 |
+
## Week 2
|
22 |
|
23 |
+
### 28 Sep 2021
|
24 |
+
|
25 |
+
* *2 hours* Project Guidance live sessions
|
26 |
+
* *1 hour* Read the project guidance notes
|
27 |
+
|
28 |
+
## 30 Sep 2021
|
29 |
+
|
30 |
+
* *0.5 hours* Initial meeting with supervisor
|
31 |
+
|
32 |
+
## Week 3
|
33 |
+
|
34 |
+
### 05 Oct 2021
|
35 |
+
|
36 |
+
* *3 hours* Read papers on text-generation
|
37 |
+
* *2 hours* Read blog posts to learn about language models, GPT-3, experiment with EleutherAI's GPT-J model.
|
38 |
+
|
39 |
+
### 06 Oct 2021
|
40 |
+
|
41 |
+
* *0.5 hours* Meeting with supervisor
|
42 |
+
|
43 |
+
## Week 4
|
44 |
+
|
45 |
+
### 12 Oct 2021
|
46 |
+
|
47 |
+
* *6 hours* Got started with a colab notebook, learning how to use causal language models to generate text, used GPT-2 and learnt about top-k and top-p sampling, greedy search and beam search.
|
48 |
+
|
49 |
+
### 13 Oct 2021
|
50 |
+
|
51 |
+
* *0.5 hours* Meeting with supervisor
|
52 |
+
|
53 |
+
## Week 5
|
54 |
+
|
55 |
+
### 19 Oct 2021
|
56 |
+
|
57 |
+
* *4 hours* Used RoBERTa, a masked language model, to fill in blank words in a sentence, given some starting words and ending words.
|
58 |
+
|
59 |
+
### 20 Oct 2021
|
60 |
+
|
61 |
+
* *0.5 hours* Meeting with supervisor
|
62 |
+
|
63 |
+
## Week 6
|
64 |
+
|
65 |
+
### 26 Oct 2021
|
66 |
+
|
67 |
+
* *3 hours* Combined a causal language model and a masked language model, GPT-2 and RoBERTa, to generate the starts of sentences and fill in the rest until the end rhyming word.
|
68 |
+
|
69 |
+
### 27 Oct 2021
|
70 |
+
|
71 |
+
* *0.5 hours* Meeting with supervisor
|
72 |
+
* *1 hour* Created GitHub repository and uploaded dissertation and project template from moodle
|