Spaces:
Sleeping
Sleeping
TahaRasouli
commited on
Commit
•
5051937
1
Parent(s):
c6b37f2
Update evaluator.py
Browse filesUpdate the band descriptors!
- evaluator.py +97 -1
evaluator.py
CHANGED
@@ -277,7 +277,103 @@ class IELTSTask1Evaluator:
|
|
277 |
|
278 |
def evaluate_task1_response(self, question, graph_analysis, written_response):
|
279 |
score_prompt = """Provide the scores for the following IELTS Task 1 essay based on the graph analysis provided and the written response. Score in terms of Task Achievement, Coherence and Cohesion, Lexical Resource, and Grammatical Range & Accuracy criteria. The scores should be in IELTS framework. Each criterion should be scored between 1 to 9 and should be integer. E.g. 5.5 is not acceptable! For each criteria that you score, provide 3 different comments using the band descriptors and by referencing both the key features of the graph and how well they were described in the response.
|
280 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
281 |
Question: {}
|
282 |
Graph Analysis: {}
|
283 |
Written Response: {}
|
|
|
277 |
|
278 |
def evaluate_task1_response(self, question, graph_analysis, written_response):
|
279 |
score_prompt = """Provide the scores for the following IELTS Task 1 essay based on the graph analysis provided and the written response. Score in terms of Task Achievement, Coherence and Cohesion, Lexical Resource, and Grammatical Range & Accuracy criteria. The scores should be in IELTS framework. Each criterion should be scored between 1 to 9 and should be integer. E.g. 5.5 is not acceptable! For each criteria that you score, provide 3 different comments using the band descriptors and by referencing both the key features of the graph and how well they were described in the response.
|
280 |
+
IELTS Task 1 Band Descriptors:
|
281 |
+
|
282 |
+
Band 9:
|
283 |
+
• Fully satisfies all requirements of the task
|
284 |
+
• Clearly presents a fully developed response
|
285 |
+
• Uses cohesion in such a way that it attracts no attention
|
286 |
+
• Skilfully manages paragraphing
|
287 |
+
• Uses a wide range of vocabulary with very natural and sophisticated control of lexical features; rare minor errors occur only as 'slips'
|
288 |
+
• Uses a wide range of structures with full flexibility and accuracy; rare minor errors occur only as 'slips'
|
289 |
+
|
290 |
+
Band 8:
|
291 |
+
• Covers all requirements of the task sufficiently
|
292 |
+
• Presents, highlights and illustrates key features/bullet points clearly and appropriately
|
293 |
+
• Sequences information and ideas logically
|
294 |
+
• Manages all aspects of cohesion well
|
295 |
+
• Uses paragraphing sufficiently and appropriately
|
296 |
+
• Uses a wide range of vocabulary fluently and flexibly to convey precise meanings
|
297 |
+
• Skilfully uses uncommon lexical items but there may be occasional inaccuracies in word choice and collocation
|
298 |
+
• Produces rare errors in spelling and/or word formation
|
299 |
+
• Uses a wide range of structures
|
300 |
+
• The majority of sentences are error-free
|
301 |
+
• Makes only very occasional errors or inappropriacies
|
302 |
+
|
303 |
+
Band 7:
|
304 |
+
• Covers the requirements of the task
|
305 |
+
• Presents a clear overview of main trends, differences or stages
|
306 |
+
• Clearly presents and highlights key features/bullet points but could be more fully extended
|
307 |
+
• Logically organises information and ideas; there is clear progression throughout
|
308 |
+
• Uses a range of cohesive devices appropriately although there may be some under-/over-use
|
309 |
+
• Uses a sufficient range of vocabulary to allow some flexibility and precision
|
310 |
+
• Uses less common lexical items with some awareness of style and collocation
|
311 |
+
• May produce occasional errors in word choice, spelling and/or word formation
|
312 |
+
• Uses a variety of complex structures
|
313 |
+
• Produces frequent error-free sentences
|
314 |
+
• Has good control of grammar and punctuation but may make a few errors
|
315 |
+
|
316 |
+
Band 6:
|
317 |
+
• Addresses the requirements of the task
|
318 |
+
• Presents an overview with information appropriately selected
|
319 |
+
• Presents and adequately highlights key features/bullet points but details may be irrelevant, inappropriate or inaccurate
|
320 |
+
• Arranges information and ideas coherently and there is a clear overall progression
|
321 |
+
• Uses cohesive devices effectively, but cohesion within and/or between sentences may be faulty or mechanical
|
322 |
+
• May not always use referencing clearly or appropriately
|
323 |
+
• Uses an adequate range of vocabulary for the task
|
324 |
+
• Attempts to use less common vocabulary but with some inaccuracy
|
325 |
+
• Makes some errors in spelling and/or word formation, but they do not impede communication
|
326 |
+
• Uses a mix of simple and complex sentence forms
|
327 |
+
• Makes some errors in grammar and punctuation but they rarely reduce communication
|
328 |
+
|
329 |
+
Band 5:
|
330 |
+
• Generally addresses the task; the format may be inappropriate in places
|
331 |
+
• Recounts detail mechanically with no clear overview; there may be no data to support the description
|
332 |
+
• Presents, but inadequately covers, key features/bullet points; there may be a tendency to focus on details
|
333 |
+
• Presents information with some organisation but there may be a lack of overall progression
|
334 |
+
• Makes inadequate, inaccurate or over-use of cohesive devices
|
335 |
+
• May be repetitive because of lack of referencing and substitution
|
336 |
+
• Uses a limited range of vocabulary, but this is minimally adequate for the task
|
337 |
+
• May make noticeable errors in spelling and/or word formation that may cause some difficulty for the reader
|
338 |
+
• Uses only a limited range of structures
|
339 |
+
• Attempts complex sentences but these tend to be less accurate than simple sentences
|
340 |
+
• May make frequent grammatical errors and punctuation may be faulty; errors can cause some difficulty for the reader
|
341 |
+
|
342 |
+
Band 4:
|
343 |
+
• Attempts to address the task but does not cover all key features/bullet points; the format may be inappropriate
|
344 |
+
• May confuse key features/bullet points with detail; parts may be unclear, irrelevant, repetitive or inaccurate
|
345 |
+
• Presents information and ideas but these are not arranged coherently and there is no clear progression
|
346 |
+
• Uses some basic cohesive devices but these may be inaccurate or repetitive
|
347 |
+
• Uses only basic vocabulary which may be used repetitively or which may be inappropriate for the task
|
348 |
+
• Has limited control of word formation and/or spelling; errors may cause strain for the reader
|
349 |
+
• Uses only a very limited range of structures with only rare use of subordinate clauses
|
350 |
+
• Some structures are accurate but errors predominate, and punctuation is often faulty
|
351 |
+
|
352 |
+
Band 3:
|
353 |
+
• Fails to address the task, which may have been completely misunderstood
|
354 |
+
• Presents limited ideas which may be largely irrelevant/repetitive
|
355 |
+
• Does not organise ideas logically
|
356 |
+
• May use a very limited range of cohesive devices, and those used may not indicate a logical relationship between ideas
|
357 |
+
• Uses only a very limited range of words and expressions with very limited control of word formation and/or spelling
|
358 |
+
• Errors may severely distort the message
|
359 |
+
• Attempts sentence forms but errors in grammar and punctuation predominate and distort the meaning
|
360 |
+
|
361 |
+
Band 2:
|
362 |
+
• Answer is barely related to the task
|
363 |
+
• Has very little control of organisational features
|
364 |
+
• Uses an extremely limited range of vocabulary; essentially no control of word formation and/or spelling
|
365 |
+
• Cannot use sentence forms except in memorised phrases
|
366 |
+
|
367 |
+
Band 1:
|
368 |
+
• Answer is completely unrelated to the task
|
369 |
+
• Fails to communicate any message
|
370 |
+
• Can only use a few isolated words
|
371 |
+
• Cannot use sentence forms at all
|
372 |
+
|
373 |
+
Band 0:
|
374 |
+
• Does not attend
|
375 |
+
• Does not attempt the task in any way
|
376 |
+
• Writes a totally memorised response
|
377 |
Question: {}
|
378 |
Graph Analysis: {}
|
379 |
Written Response: {}
|