leehenry/xmemtransfer-llama2-source-30m

XMemTransfer LLaMA-2 source memory (30M)

This repository contains a frozen source-memory artifact used in the XMemTransfer experiments.

Project links

• Website: https://olaresearch.org/XMemTransfer
• Code: https://github.com/OLAResearch
• Models: https://huggingface.co/OLAResearchX

Files

• memory.pt: source memory checkpoint
• memory_best.pt: best checkpoint selected during source training
• memory_config.json: hash and memory configuration
• source_adaptor_best.pt: source-side adaptor checkpoint used with the source memory

Intended use

This artifact is meant to be paired with target-side adaptors from the XMemTransfer project for cross-model memory-transfer experiments.

Provenance

• source model family: LLaMA-2 7B
• source corpus: WikiText-2021
• source token budget: 30M