Convert factor to number, properly