Yes, your guinea pig can safely eat both celery stalks and leaves in moderation. Just make sure you rinse them off before feeding a small bite to your guinea pig.