Ensure fragment has been added before restoring list view scroll position.

Might help with #1928.