build: Clean up vala warnings a bit more

This isn't perfect, we're really not strict now with compiler arguments
passed, but we still get some warnings sadly