RvanB commited on
Commit
e928541
1 Parent(s): 4cd9732

Update readme

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -22,12 +22,12 @@ Try out our [interactive demo](https://huggingface.co/spaces/cdlib/marc-match-ai
22
  - Adjustable Matching Threshold: Allows tuning the balance between false positives and false negatives based on specific use cases.
23
 
24
  ## Performance
25
- This model achieves 98.46% accuracy on our validation set (see our [dataset](https://github.com/cdlib/marc-ai)), and had comparable accuracy with SCSB, Goldrush, and OCLC matching (with and without merging with the WorldCat API). Each matching algorithm was run on a common set of English monographs to produce a union set of all of the algorithms' matches, and a matching threshold of 0.99 was chosen for our model to minimize false positives. Disagreements between the algorithms were manually reviewed, resulting in false positives and false negatives for those disagreements:
 
 
26
 
27
  | Algorithm | % False Positives | % False Negatives |
28
  |-----------------|-------------------|-------------------|
29
  | Goldrush | 0.30% | 4.79% |
30
  | SCSB | 0.52% | 0.40% |
31
  | __Our Model__ | __0.23%__ | __1.95%__ |
32
- | OCLC | 0.05% | 2.73% |
33
- | OCLC Reconciled | 0.10% | 1.23% |
 
22
  - Adjustable Matching Threshold: Allows tuning the balance between false positives and false negatives based on specific use cases.
23
 
24
  ## Performance
25
+ This model achieves 98.46% accuracy on our validation set (see our [GitHub repository](https://github.com/cdlib/marc-ai) for datasets).
26
+
27
+ It has also had comparable accuracy with SCSB, and Goldrush on a separate set of English monographs. Each matching algorithm was run on a common set to produce a union set of all of the algorithms' matches. Using a matching threshold of 0.99 to minimize false positives, we were able to compare the algorithms' matches. Disagreements between the algorithms were manually reviewed, resulting in false positives and false negatives for those disagreements:
28
 
29
  | Algorithm | % False Positives | % False Negatives |
30
  |-----------------|-------------------|-------------------|
31
  | Goldrush | 0.30% | 4.79% |
32
  | SCSB | 0.52% | 0.40% |
33
  | __Our Model__ | __0.23%__ | __1.95%__ |