The RecordLayout builder might deserialize decls, too.