As already mentioned, cavies are clean little critters and don't usually give off an unpleasant smell. But when a guinea pig's environment isn't maintained correctly, or they are fed the wrong foods, these pocket pets can quickly stink up the room.