Fix speedups checks and switching
Fix float size tests to be looser for pure Python mode