fix vlc overflow

approved at: https://rbcommons.com/s/OpenH264/r/460/

1. if vlc overflow, re-encoding this macroblock by adding 2 for mb_quant.
2. remove temporally fix quant macro
3. merge "removing warnings" into this branch in util.h