Try using IN_DELETE_SELF with inotify