[layouts] Don't apply adapter constraints when restoring items

Fixes #146