Add --error_on_mulitple command line argument

This helps in cases where you want to script reading the value from
an invocation.