Titovs commited on
Commit
6c11656
1 Parent(s): 9feabd3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -83,6 +83,8 @@ We clean the content of the remaining dataset entries according to the following
83
  * We remove all package lines, such as _package kotlinx.coroutines.channels_
84
  * We remove half of the import lines
85
 
 
 
86
  # Evaluation
87
 
88
  For evaluation, we used the [Kotlin HumanEval](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval) dataset, which contains all 161 tasks from HumanEval translated into Kotlin by human experts. You can find more details about the pre-processing necessary to obtain our results, including the code for running, on the [datasets's page](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval).
 
83
  * We remove all package lines, such as _package kotlinx.coroutines.channels_
84
  * We remove half of the import lines
85
 
86
+ We removed half of the imports to avoid potential hallucinations by the model, where it might attempt to import unnecessary libraries. Additionally, packages were removed because this information is only useful at the project level and may introduce additional noise during the learning process.
87
+
88
  # Evaluation
89
 
90
  For evaluation, we used the [Kotlin HumanEval](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval) dataset, which contains all 161 tasks from HumanEval translated into Kotlin by human experts. You can find more details about the pre-processing necessary to obtain our results, including the code for running, on the [datasets's page](https://huggingface.co/datasets/JetBrains/Kotlin_HumanEval).