ink-pad mnagired commited on
Commit
cf1abab
1 Parent(s): d40ae23

updated with technical report (#2)

Browse files

- updated with technical report (193c737d9048c83610e53f2de9776616eabec997)


Co-authored-by: Manish Nagireddy <mnagired@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -20,6 +20,7 @@ It outperforms other open-source models in the same space on standard benchmarks
20
  - **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/)
21
  - **Release Date**: October 21st, 2024
22
  - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
 
23
 
24
 
25
  ## Usage
@@ -262,4 +263,18 @@ For risks in RAG use cases, the model is evaluated on [TRUE](https://github.com/
262
 
263
  | Metric | mnbm | begin | qags_xsum | qags_cnndm | summeval | dialfact | paws | q2 | frank | Average |
264
  |---------|------|-------|-----------|------------|----------|----------|------|------|-------|---------|
265
- | **AUC** | 0.72 | 0.75 | 0.79 | 0.79 | 0.81 | 0.91 | 0.82 | 0.85 | 0.89 | 0.81 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  - **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/)
21
  - **Release Date**: October 21st, 2024
22
  - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
23
+ - **Technical Report:** [Granite Guardian](https://arxiv.org/abs/2412.07724)
24
 
25
 
26
  ## Usage
 
263
 
264
  | Metric | mnbm | begin | qags_xsum | qags_cnndm | summeval | dialfact | paws | q2 | frank | Average |
265
  |---------|------|-------|-----------|------------|----------|----------|------|------|-------|---------|
266
+ | **AUC** | 0.72 | 0.75 | 0.79 | 0.79 | 0.81 | 0.91 | 0.82 | 0.85 | 0.89 | 0.81 |
267
+
268
+
269
+ ### Citation Information
270
+ ```
271
+ @misc{padhi2024graniteguardian,
272
+ title={Granite Guardian},
273
+ author={Inkit Padhi and Manish Nagireddy and Giandomenico Cornacchia and Subhajit Chaudhury and Tejaswini Pedapati and Pierre Dognin and Keerthiram Murugesan and Erik Miehling and Martín Santillán Cooper and Kieran Fraser and Giulio Zizzo and Muhammad Zaid Hameed and Mark Purcell and Michael Desmond and Qian Pan and Inge Vejsbjerg and Elizabeth M. Daly and Michael Hind and Werner Geyer and Ambrish Rawat and Kush R. Varshney and Prasanna Sattigeri},
274
+ year={2024},
275
+ eprint={2412.07724},
276
+ archivePrefix={arXiv},
277
+ primaryClass={cs.CL},
278
+ url={https://arxiv.org/abs/2412.07724},
279
+ }
280
+ ```