Add test suite for autoreload extension

Closes gh-1912
Merge pull request #3488 from takluyver/test_autoreload

Add test suite for autoreload extension