Attempt to keep track of modified sources, to avoid recompiling every test every time