ilmControl: Return REMOVED immediatly when notification is set even if wl_surface is not set to ivi_surface.

Signed-off-by: Nobuhiko Tanibata <NOBUHIKO_TANIBATA@denso.co.jp>