Remove some asserts, trust the bytecode