TahaRasouli commited on
Commit
5051937
1 Parent(s): c6b37f2

Update evaluator.py

Browse files

Update the band descriptors!

Files changed (1) hide show
  1. evaluator.py +97 -1
evaluator.py CHANGED
@@ -277,7 +277,103 @@ class IELTSTask1Evaluator:
277
 
278
  def evaluate_task1_response(self, question, graph_analysis, written_response):
279
  score_prompt = """Provide the scores for the following IELTS Task 1 essay based on the graph analysis provided and the written response. Score in terms of Task Achievement, Coherence and Cohesion, Lexical Resource, and Grammatical Range & Accuracy criteria. The scores should be in IELTS framework. Each criterion should be scored between 1 to 9 and should be integer. E.g. 5.5 is not acceptable! For each criteria that you score, provide 3 different comments using the band descriptors and by referencing both the key features of the graph and how well they were described in the response.
280
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
281
  Question: {}
282
  Graph Analysis: {}
283
  Written Response: {}
 
277
 
278
  def evaluate_task1_response(self, question, graph_analysis, written_response):
279
  score_prompt = """Provide the scores for the following IELTS Task 1 essay based on the graph analysis provided and the written response. Score in terms of Task Achievement, Coherence and Cohesion, Lexical Resource, and Grammatical Range & Accuracy criteria. The scores should be in IELTS framework. Each criterion should be scored between 1 to 9 and should be integer. E.g. 5.5 is not acceptable! For each criteria that you score, provide 3 different comments using the band descriptors and by referencing both the key features of the graph and how well they were described in the response.
280
+ IELTS Task 1 Band Descriptors:
281
+
282
+ Band 9:
283
+ • Fully satisfies all requirements of the task
284
+ • Clearly presents a fully developed response
285
+ • Uses cohesion in such a way that it attracts no attention
286
+ • Skilfully manages paragraphing
287
+ • Uses a wide range of vocabulary with very natural and sophisticated control of lexical features; rare minor errors occur only as 'slips'
288
+ • Uses a wide range of structures with full flexibility and accuracy; rare minor errors occur only as 'slips'
289
+
290
+ Band 8:
291
+ • Covers all requirements of the task sufficiently
292
+ • Presents, highlights and illustrates key features/bullet points clearly and appropriately
293
+ • Sequences information and ideas logically
294
+ • Manages all aspects of cohesion well
295
+ • Uses paragraphing sufficiently and appropriately
296
+ • Uses a wide range of vocabulary fluently and flexibly to convey precise meanings
297
+ • Skilfully uses uncommon lexical items but there may be occasional inaccuracies in word choice and collocation
298
+ • Produces rare errors in spelling and/or word formation
299
+ • Uses a wide range of structures
300
+ • The majority of sentences are error-free
301
+ • Makes only very occasional errors or inappropriacies
302
+
303
+ Band 7:
304
+ • Covers the requirements of the task
305
+ • Presents a clear overview of main trends, differences or stages
306
+ • Clearly presents and highlights key features/bullet points but could be more fully extended
307
+ • Logically organises information and ideas; there is clear progression throughout
308
+ • Uses a range of cohesive devices appropriately although there may be some under-/over-use
309
+ • Uses a sufficient range of vocabulary to allow some flexibility and precision
310
+ • Uses less common lexical items with some awareness of style and collocation
311
+ • May produce occasional errors in word choice, spelling and/or word formation
312
+ • Uses a variety of complex structures
313
+ • Produces frequent error-free sentences
314
+ • Has good control of grammar and punctuation but may make a few errors
315
+
316
+ Band 6:
317
+ • Addresses the requirements of the task
318
+ • Presents an overview with information appropriately selected
319
+ • Presents and adequately highlights key features/bullet points but details may be irrelevant, inappropriate or inaccurate
320
+ • Arranges information and ideas coherently and there is a clear overall progression
321
+ • Uses cohesive devices effectively, but cohesion within and/or between sentences may be faulty or mechanical
322
+ • May not always use referencing clearly or appropriately
323
+ • Uses an adequate range of vocabulary for the task
324
+ • Attempts to use less common vocabulary but with some inaccuracy
325
+ • Makes some errors in spelling and/or word formation, but they do not impede communication
326
+ • Uses a mix of simple and complex sentence forms
327
+ • Makes some errors in grammar and punctuation but they rarely reduce communication
328
+
329
+ Band 5:
330
+ • Generally addresses the task; the format may be inappropriate in places
331
+ • Recounts detail mechanically with no clear overview; there may be no data to support the description
332
+ • Presents, but inadequately covers, key features/bullet points; there may be a tendency to focus on details
333
+ • Presents information with some organisation but there may be a lack of overall progression
334
+ • Makes inadequate, inaccurate or over-use of cohesive devices
335
+ • May be repetitive because of lack of referencing and substitution
336
+ • Uses a limited range of vocabulary, but this is minimally adequate for the task
337
+ • May make noticeable errors in spelling and/or word formation that may cause some difficulty for the reader
338
+ • Uses only a limited range of structures
339
+ • Attempts complex sentences but these tend to be less accurate than simple sentences
340
+ • May make frequent grammatical errors and punctuation may be faulty; errors can cause some difficulty for the reader
341
+
342
+ Band 4:
343
+ • Attempts to address the task but does not cover all key features/bullet points; the format may be inappropriate
344
+ • May confuse key features/bullet points with detail; parts may be unclear, irrelevant, repetitive or inaccurate
345
+ • Presents information and ideas but these are not arranged coherently and there is no clear progression
346
+ • Uses some basic cohesive devices but these may be inaccurate or repetitive
347
+ • Uses only basic vocabulary which may be used repetitively or which may be inappropriate for the task
348
+ • Has limited control of word formation and/or spelling; errors may cause strain for the reader
349
+ • Uses only a very limited range of structures with only rare use of subordinate clauses
350
+ • Some structures are accurate but errors predominate, and punctuation is often faulty
351
+
352
+ Band 3:
353
+ • Fails to address the task, which may have been completely misunderstood
354
+ • Presents limited ideas which may be largely irrelevant/repetitive
355
+ • Does not organise ideas logically
356
+ • May use a very limited range of cohesive devices, and those used may not indicate a logical relationship between ideas
357
+ • Uses only a very limited range of words and expressions with very limited control of word formation and/or spelling
358
+ • Errors may severely distort the message
359
+ • Attempts sentence forms but errors in grammar and punctuation predominate and distort the meaning
360
+
361
+ Band 2:
362
+ • Answer is barely related to the task
363
+ • Has very little control of organisational features
364
+ • Uses an extremely limited range of vocabulary; essentially no control of word formation and/or spelling
365
+ • Cannot use sentence forms except in memorised phrases
366
+
367
+ Band 1:
368
+ • Answer is completely unrelated to the task
369
+ • Fails to communicate any message
370
+ • Can only use a few isolated words
371
+ • Cannot use sentence forms at all
372
+
373
+ Band 0:
374
+ • Does not attend
375
+ • Does not attempt the task in any way
376
+ • Writes a totally memorised response
377
  Question: {}
378
  Graph Analysis: {}
379
  Written Response: {}