Patch by Berdir from https://drupal.org/files/issues/entity-reference-term-settings-2028109-1.patch