Revert "Start loading albums earlier"

This reverts commit f50727737a14e704fd9a7752dc411aa1c2f47c7a.