Don't show progress spinners on refreshes after the first load

Combined with properly restoring state from #158, this should result in a much nicer refreshing experience.