get_bits: Add OPEN_READER macro variant w/o size_plus8

This avoids a trillion warnings from MSVC.
rdft: Move some variables into a separate block

This avoids an unused variable warning with hardcoded tables.
Replace av_unused attributes by block structures

This is more portable and avoids warnings with compilers that do not
properly support av_unused.
Drop unnecessary av_unused attributes.