Move prompting code out to config.

This is highly specific to me, I'm sure someone else will want to use
something else.