Add documentation to modules.h

Add proper return code type rlm_rcode_t, and update signatures of all module functions that return rcodes