Revert "Fix random moves when time < 10ms"

Possible regression.

No functional change.
Revert "Move draw by material check"

Possible regression

bench: 4554579