Fennel works well as a celery substitute because it adds an interesting flavor and texture. Jicama, bok choy and raw green beans are all great alternatives to celery in recipes.