File size: 2,435 Bytes
968a94a a72fa1f 968a94a cac8ee3 968a94a cac8ee3 968a94a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 |
# Der Roboterlehrer: Interpretable and deterministic MQM-inspired translation evaluation
[](https://github.com/tatsu-lab/stanford_alpaca/blob/main/LICENSE) [](https://github.com/tatsu-lab/stanford_alpaca/blob/main/LICENSE) [](https://github.com/psf/black) [](https://github.com/tatsu-lab/stanford_alpaca/blob/main/LICENSE)
<!-- ABOUT THE PROJECT -->
## About The Project
We seek to create a chatbot capable of performing multidimensional translation evaluation with feedback without making any LLM API calls. We hope that this approach is more interpretable and deterministic than existing state-of-the-art.
At the moment we only support the German-English language pair.
<p align="right">(<a href="#readme-top">back to top</a>)</p>
<!-- GETTING STARTED -->
## Getting Started
### Installation
1. Clone this repository with `git clone https://github.com/aphil311/teach-bs.git`.
2. Install the dependencies with `pip install -r requirements.txt`.
- You must downgrade to `pip < 24.1` with `pip install pip=24.0` to install `laser_encoders`.
- You can upgrade after installing.
### Usage
1. Run the streamlit app with `streamlit run app.py`.
2. The chatbot will immediately prompt you with a German to English translation.
- You can switch to English to German on the sidebar.
3. Scores are computed as the raw arithmetic mean and can be found in the 'scores' sidebar tab.
<p align="right">(<a href="#readme-top">back to top</a>)</p>
<!-- ROADMAP -->
## Roadmap
<!-- - [X] **Build the model**
- [ ] **Training**
- [ ] **Validation**
- [ ] **Evaluation** -->
See the [open issues](https://github.com/aphil311/talos/issues) for a full list of proposed features (and known issues).
<!-- LICENSE -->
## License
Distributed under the MIT License. See `LICENSE.txt` for more information.
<!-- ACKNOWLEDGMENTS -->
## Acknowledgments
I would like to thank Professor Srinivas Bangalore as well as the TRA 301 TAs their for their invaluable guidance, feedback, and support.
<p align="right">(<a href="#readme-top">back to top</a>)</p> |