Revert "Hopefully fix speedup prediction"

This reverts commit 7c0e3daec788cb13ed0ea7a802d8c6e030071ac3.