neubig/travatar — pull request #19 by philip30 (2014-10-11 06:43:06+00:00)
Title: Added Advance Interpolation Evaluation Measurement

In this pull request, I added one more class the modification of eval-measure-interp, so it can support more various combination beside arithmetic mean.

The measurement can be created from this format:
"ainterp:{$VAR|[$MEASUREMENT]|}*$QUERY

$VAR is a 1 character, ranging from A-Z.
$MEASUREMENT is the other evaluation measures.
$QUERY is mathematical expression that used to combine all the measurements (containing all $VAR).

for example:
"ainterp:A|bleu:smooth=1|B|ribes|2*A*B/(A+B)"

will calculate the harmonic mean of bleu+1 and ribes together.

Current limitation:
Query can support only binary operator {+,-,/,*} with open and closed parentheses.
However, the operator precedence's is already supported.