Newline in PS1 makes readline unhappy

When it comes to very long directory names (or very narrow terminals),
having a newline inside PS1 makes readline confused about the width of
my prompt.  (And no, \[\n\] doesn't help at all.)