Remove gem file and ignore them from now on.