only remove remote dir if we're using remote