OLAResearchX/xmemtransfer-llama2-source-20m

XMemTransfer LLaMA-2 source memory (20M)

This repository contains a frozen source-memory artifact used in the XMemTransfer experiments.

Project links

• Website: https://olaresearch.org/XMemTransfer
• Code: https://github.com/OLAResearch
• Model repo: https://huggingface.co/OLAResearchX/xmemtransfer-llama2-source-20m
• Collection: https://huggingface.co/collections/OLAResearchX/xmemtransfer

Files

• memory.pt: source memory checkpoint
• memory_best.pt: best checkpoint selected during source training
• memory_config.json: hash and memory configuration
• source_adaptor_best.pt: source-side adaptor checkpoint used with the source memory

Intended use

This artifact is meant to be paired with target-side adaptors from the XMemTransfer project for cross-model memory-transfer experiments.

Provenance

• source model family: LLaMA-2 7B
• source corpus: WikiText-2021
• source token budget: 20M