Stop opening all affected files

This could be overkill on large projects