Celery isn’t a high sugar food for humans, but it is far higher in sugar than the grass hay that should make up the bulk of your rabbit’s diet. The sugar content is one reason why rabbits like celery, and it’s also a key reason for feeding celery in small amounts.