[ux] Notify user if the application doesn't exist

Fixes #421.

@Swaagie can you review?