Delete directly if not a folder