Remove TODOs from the code

Remaining tasks are now listed as github issues.