Fix selection update after fs change event

Also, remove unnecessary updates when no added or removed files are present.

Fixes #6357