Spaces:
Sleeping
Sleeping
Blair Yang
commited on
Commit
•
eabbcfc
1
Parent(s):
195be44
update
Browse files- Config.py +2 -1
- __pycache__/Config.cpython-311.pyc +0 -0
- __pycache__/models.cpython-311.pyc +0 -0
- __pycache__/utils.cpython-311.pyc +0 -0
- prompts/summarize/user.txt +2 -1
Config.py
CHANGED
|
@@ -29,7 +29,8 @@ RANDOM_SEED = 42
|
|
| 29 |
|
| 30 |
|
| 31 |
|
| 32 |
-
DEFAULT_SUMMARIZER = "NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO"
|
|
|
|
| 33 |
DEFAULT_DATASET = "mmlu"
|
| 34 |
DEFAULT_TOPIC = random.choice(TOPICS[DEFAULT_DATASET])
|
| 35 |
|
|
|
|
| 29 |
|
| 30 |
|
| 31 |
|
| 32 |
+
# DEFAULT_SUMMARIZER = "NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO"
|
| 33 |
+
DEFAULT_SUMMARIZER = 'mistralai/Mistral-7B-Instruct-v0.2'
|
| 34 |
DEFAULT_DATASET = "mmlu"
|
| 35 |
DEFAULT_TOPIC = random.choice(TOPICS[DEFAULT_DATASET])
|
| 36 |
|
__pycache__/Config.cpython-311.pyc
CHANGED
|
Binary files a/__pycache__/Config.cpython-311.pyc and b/__pycache__/Config.cpython-311.pyc differ
|
|
|
__pycache__/models.cpython-311.pyc
CHANGED
|
Binary files a/__pycache__/models.cpython-311.pyc and b/__pycache__/models.cpython-311.pyc differ
|
|
|
__pycache__/utils.cpython-311.pyc
CHANGED
|
Binary files a/__pycache__/utils.cpython-311.pyc and b/__pycache__/utils.cpython-311.pyc differ
|
|
|
prompts/summarize/user.txt
CHANGED
|
@@ -13,9 +13,10 @@
|
|
| 13 |
|
| 14 |
# Format
|
| 15 |
|
| 16 |
-
You should follow a Markdown format with two headings: "Relevant Parts"
|
| 17 |
- The "Relevant Parts" section should include the copied text from the student's evaluation.
|
| 18 |
- The "Summary" section should include a human-readable summary of the copied text.
|
|
|
|
| 19 |
|
| 20 |
IMPORTANT Requirements:
|
| 21 |
- Don't answer the question, but rather extract parts from the student's evaluation that are relevant to the question.
|
|
|
|
| 13 |
|
| 14 |
# Format
|
| 15 |
|
| 16 |
+
You should follow a Markdown format with two headings: "Relevant Parts", "Summary", "Question Difficulty".
|
| 17 |
- The "Relevant Parts" section should include the copied text from the student's evaluation.
|
| 18 |
- The "Summary" section should include a human-readable summary of the copied text.
|
| 19 |
+
- The "Question Difficulty" part should give an objective, unbiased evaluation of the relative difficulty of the quesiton. Rate it on a scale of 1-5.
|
| 20 |
|
| 21 |
IMPORTANT Requirements:
|
| 22 |
- Don't answer the question, but rather extract parts from the student's evaluation that are relevant to the question.
|