base data directory now specified as a separate parameter
minor fixes
improved version of lambda search: update to next value if performance
is above some threshold for the current value