gpt2_large_prefix_682k / scripts /preprocess_data.py
augustocsc's picture
GPT-2 Large trained on prefix dataset (682K)
451da7d verified
# Script para pré-processar dados (raw -> processed)