Is there another person you can recommend to champion the project, and then support them in the effort?
You can say no without guilt, still be involved in the fun, and avoid taking on more than you can chew.