Lazily allocate the attachments map