results are saved to file on assertion failure for later use
version bump
ignore check dir