Issue 15: Clear caches on Rally configuration changes.

Also, added a button to manually trigger the refresh.