File size: 847 Bytes
6b71cc4 52ac1d3 6b71cc4 52ac1d3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | ---
tags:
- model_hub_mixin
- pytorch_model_hub_mixin
license: wtfpl
datasets:
- bobox/OpenbookQA-4ST
language:
- en
base_model:
- LocalWisdom/PurpleCBoW
pipeline_tag: feature-extraction
---
# PurpleFastText
A simple implementation of FastText from https://arxiv.org/pdf/1607.04606.
Made for beginner to reference and learn from. This repository contains `tokenizer.json`, `model.safetensors`, and `train.ipynb`.
The training workflow use modern libraries like HuggingFace's datasets and tokenizers. The rest is just PyTorch.
There are some algorithm which we decided to not implement which is the hashing function from the original paper.
The resulting training workflow is not as fast as the paper suggest, maybe it is because of the use of Python instead
of [Hogwild!](https://people.eecs.berkeley.edu/~brecht/papers/hogwildTR.pdf) instead. |