Speculative exection should be turned off when we have as few slots as we do