Instructions to use toolathlon-eval-17/MyAwesomeModel-TestRepo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use toolathlon-eval-17/MyAwesomeModel-TestRepo with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("toolathlon-eval-17/MyAwesomeModel-TestRepo", device_map="auto") - Notebooks
- Google Colab
- Kaggle
MyAwesomeModel
1. Introduction
The MyAwesomeModel has undergone a significant version upgrade. In the latest update, MyAwesomeModel has significantly improved its depth of reasoning and inference capabilities by leveraging increased computational resources and introducing algorithmic optimization mechanisms during post-training. The model has demonstrated outstanding performance across various benchmark evaluations, including mathematics, programming, and general logic. Its overall performance is now approaching that of other leading models.
Compared to the previous version, the upgraded model shows significant improvements in handling complex reasoning tasks. For instance, in the AIME 2025 test, the model's accuracy has increased from 70% in the previous version to 87.5% in the current version. This advancement stems from enhanced thinking depth during the reasoning process: in the AIME test set, the previous model used an average of 12K tokens per question, whereas the new version averages 23K tokens per question.
Beyond its improved reasoning capabilities, this version also offers a reduced hallucination rate and enhanced support for function calling.
2. Evaluation Results
Comprehensive Benchmark Results
| Benchmark | Model1 | Model2 | Model1-v2 | MyAwesomeModel | |
|---|---|---|---|---|---|
| Core Reasoning Tasks | Math Reasoning | 0.510 | 0.535 | 0.521 | 0.590 |
| Logical Reasoning | 0.789 | 0.801 | 0.810 | 0.879 | |
| Common Sense | 0.716 | 0.702 | 0.725 | 0.836 | |
| Language Understanding | Reading Comprehension | 0.671 | 0.685 | 0.690 | 0.811 |
| Question Answering | 0.582 | 0.599 | 0.601 | 0.742 | |
| Text Classification | 0.803 | 0.811 | 0.820 | 0.873 | |
| Sentiment Analysis | 0.777 | 0.781 | 0.790 | 0.837 | |
| Generation Tasks | Code Generation | 0.615 | 0.631 | 0.640 | 0.765 |
| Creative Writing | 0.588 | 0.579 | 0.601 | 0.768 | |
| Dialogue Generation | 0.621 | 0.635 | 0.639 | 0.711 | |
| Summarization | 0.745 | 0.755 | 0.760 | 0.845 | |
| Specialized Capabilities | Translation | 0.782 | 0.799 | 0.801 | 0.872 |
| Knowledge Retrieval | 0.651 | 0.668 | 0.670 | 0.781 | |
| Instruction Following | 0.733 | 0.749 | 0.751 | 0.843 | |
| Safety Evaluation | 0.718 | 0.701 | 0.725 | 0.818 |
Overall Performance Summary
The MyAwesomeModel demonstrates strong performance across all evaluated benchmark categories, with particularly notable results in reasoning and generation tasks.
3. Chat Website & API Platform
We offer a chat interface and API for you to interact with MyAwesomeModel. Please check our official website for more details.
4. How to Run Locally
Please refer to our code repository for more information about running MyAwesomeModel locally.
Compared to previous versions, the usage recommendations for MyAwesomeModel have the following changes:
- System prompt is supported.
- All common Chinese languages are supported.
- Temperature parameter $T_{model}$ is now set to 0.6.
System Prompt
We recommend using the following system prompt with a specific date.
You are MyAwesomeModel, a helpful AI assistant.
Today is {current date}.
For example,
You are MyAwesomeModel, a helpful AI assistant.
Today is May 28, 2025, Monday.
Temperature
5. License
This code repository is licensed under the MIT License. The use of MyAwesomeModel models is also subject to the MIT License. The model series supports commercial use and distillation.
6. Contact
If you have any questions, please raise an issue on our GitHub repository or contact us at contact@MyAwesomeModel.ai: ```