Better return value for maxed-out layer check-adds

Returning "0" when someone's already in the top layer is misleading,
it's better to just return the top layer index.