Task #6: Test an experimental auto-update mechanism
Description: See the issue description.
Reviewer: tomghuang