We do need a better strategy here. I'd test this by getting turning reloading off, rendering the template, changing it on the fileystem, testing the rendered version is unchanged, invalidating the template cache, rendering the template, testing that the changes are now seen.