Actually check for all the headers we use

Removed useless comments
We're not using anything from assert.h