Fix #150 - Path resolution is done everytime an fs change happens

Fix #150
We should file a bug to document this, that it's measured in ms vs. s, etc.