add UT for LTR setopton and fix crash issue

reviewed at: https://rbcommons.com/s/OpenH264/r/788/