o_direct: review comments

Fix styler
Clarify tricky pieces of the code (at least make them clearer to yours
truly).
Fix a bug with incorrect return value from fwrite() & O_DIRECT.