Edit model card

Data influence models for LAMBADA fine-tuned from bert-base-uncased.

The main branch contains the data influence model for 10k steps.

Paper: MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models

Official codebase: https://github.com/cxcscmu/MATES

Downloads last month
4
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train yuzc19/bert-base-uncased-data-influence-model-lambada