Give a specific exception for removing a not-there source. Fixes #770