# Timelog

* Text-generation with rhyme and rhythm
* Ans Farooq
* 2390370f
* Jake Lever

## Guidance

* This file contains the time log for your project. It will be submitted along with your final dissertation.
* **YOU MUST KEEP THIS UP TO DATE AND UNDER VERSION CONTROL.**
* This timelog should be filled out honestly, regularly (daily) and accurately. It is for *your* benefit.
* Follow the structure provided, grouping time by weeks.  Quantise time to the half hour.

## Week 1

### 21 Sep 2021

* *6 hours* Read through project proposals and rank best 8 and enter bids into system

## Week 2

### 28 Sep 2021

* *2 hours* Project Guidance live sessions
* *1 hour* Read the project guidance notes

## 30 Sep 2021

* *0.5 hours* Initial meeting with supervisor

## Week 3

### 05 Oct 2021

* *3 hours* Read papers on text-generation
* *2 hours* Read blog posts to learn about language models, GPT-3, experiment with EleutherAI's GPT-J model.

### 06 Oct 2021

* *0.5 hours* Meeting with supervisor

## Week 4

### 12 Oct 2021

* *6 hours* Got started with a colab notebook, learning how to use causal language models to generate text, used GPT-2 and learnt about top-k and top-p sampling, greedy search and beam search.

### 13 Oct 2021

* *0.5 hours* Meeting with supervisor

## Week 5

### 19 Oct 2021

* *4 hours* Used RoBERTa, a masked language model, to fill in blank words in a sentence, given some starting words and ending words.

### 20 Oct 2021

* *0.5 hours* Meeting with supervisor

## Week 6

### 26 Oct 2021

* *3 hours* Combined a causal language model and a masked language model, GPT-2 and RoBERTa, to generate the starts of sentences and fill in the rest until the end rhyming word.

### 27 Oct 2021

* *0.5 hours* Meeting with supervisor
* *1 hour* Created GitHub repository and uploaded dissertation and project template from moodle

### 29 Oct 2021
* *0.5 hours* Created prototypes directory on GitHub and saved first prototype directly from Colab to GitHub

## Week 7

### 2 Nov 2021
* *5 hours* Used Python library to find rhyming words and wikipedia library to feed topic summary into GPT-2 before text generation

### 3 Nov 2021

* *0.5 hours* Meeting with supervisor