Remove hacky check for gem removal/installation