tests: add read_format_range_check and sample_type_range_check tests

In the end they weren't buggy due to the use of enum rather than #define