Don't load the full debugger when readline is the formula being installed

Fixes #27842.