Loading scores with layers

Fix #29286
Prevent crash on loading scores with more than just the default layer in
them.