Towards Realistic Evaluation of Commit Message Generation by Matching Online and Offline Settings
Paper
•
2410.12046
•
Published
📊 Commit Message Generation Evaluation 🔍
All the resources for our "Towards Realistic Evaluation of Commit Message Generation by Matching Online and Offline Settings" study on CMG metrics!
-
Sleeping📈Commit Message Editing Visualization
Note An app with visualizations and statistics for our commit message edits dataset and its synthetic extension. ❗Contains code for generating synthetic data, code for metrics selection, and code for plotting edit distance distributions. Check README for more details!
Sleeping✍️Commit Message Editing
Note An app for collecting commit message edits from human labelers.
JetBrains-Research/commit-msg-edits
Viewer • Updated • 116 • 60Note Our expert-labeled commit message edits dataset.
JetBrains-Research/synthetic-commit-msg-edits
Viewer • Updated • 12.2k • 78Note Synthetic extension of our commit message edits dataset.