Remove local gem ref.