Lazily create diagonals per level
Laziness saves the day