Remove unnecessary check

Further improves fe6795148fc that improved 2d9538eb77
Suggested-By: @AD7six