timelog.md

Timelog

• Text-generation with rhyme and rhythm
• Ans Farooq
• 2390370f
• Jake Lever

Guidance

• This file contains the time log for your project. It will be submitted along with your final dissertation.
• YOU MUST KEEP THIS UP TO DATE AND UNDER VERSION CONTROL.
• This timelog should be filled out honestly, regularly (daily) and accurately. It is for your benefit.
• Follow the structure provided, grouping time by weeks. Quantise time to the half hour.

Week 1

21 Sep 2021

• 6 hours Read through project proposals and rank best 8 and enter bids into system

Week 2

28 Sep 2021

• 2 hours Project Guidance live sessions
• 1 hour Read the project guidance notes

30 Sep 2021

• 0.5 hours Initial meeting with supervisor

Week 3

05 Oct 2021

• 3 hours Read papers on text-generation
• 2 hours Read blog posts to learn about language models, GPT-3, experiment with EleutherAI's GPT-J model.

06 Oct 2021

• 0.5 hours Meeting with supervisor

Week 4

12 Oct 2021

• 6 hours Got started with a colab notebook, learning how to use causal language models to generate text, used GPT-2 and learnt about top-k and top-p sampling, greedy search and beam search.

13 Oct 2021

• 0.5 hours Meeting with supervisor

Week 5

19 Oct 2021

• 4 hours Used RoBERTa, a masked language model, to fill in blank words in a sentence, given some starting words and ending words.

20 Oct 2021

• 0.5 hours Meeting with supervisor

Week 6

26 Oct 2021

• 3 hours Combined a causal language model and a masked language model, GPT-2 and RoBERTa, to generate the starts of sentences and fill in the rest until the end rhyming word.

27 Oct 2021

• 0.5 hours Meeting with supervisor
• 1 hour Created GitHub repository and uploaded dissertation and project template from moodle

29 Oct 2021

• 0.5 hours Created prototypes directory on GitHub and saved first prototype directly from Colab to GitHub

Week 7

2 Nov 2021

• 5 hours Used Python library to find rhyming words and wikipedia library to feed topic summary into GPT-2 before text generation

3 Nov 2021

• 0.5 hours Meeting with supervisor