ink-pad mnagired commited on
Commit
efc8fdc
1 Parent(s): 6a9938d

added technical report (#2)

Browse files

- added technical report (ba48a7d37774c95ccd9f790ec131e052d51f2cdd)


Co-authored-by: Manish Nagireddy <mnagired@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -20,6 +20,7 @@ It outperforms other open-source models in the same space on standard benchmarks
20
  - **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/)
21
  - **Release Date**: October 21st, 2024
22
  - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
 
23
 
24
  ## Usage
25
  ### Intended Use
@@ -260,4 +261,16 @@ For risks in RAG use cases, the model is evaluated on [TRUE](https://github.com/
260
 
261
  | Metric | mnbm | begin | qags_xsum | qags_cnndm | summeval | dialfact | paws | q2 | frank | Average |
262
  |---------|------|-------|-----------|------------|----------|----------|------|------|-------|---------|
263
- | **AUC** | 0.71 | 0.80 | 0.83 | 0.89 | 0.84 | 0.94 | 0.88 | 0.88 | 0.90 | 0.85 |
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  - **Website**: [Granite Guardian Docs](https://www.ibm.com/granite/docs/models/guardian/)
21
  - **Release Date**: October 21st, 2024
22
  - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
23
+ - **Technical Report:** [Granite Guardian](https://arxiv.org/abs/2412.07724)
24
 
25
  ## Usage
26
  ### Intended Use
 
261
 
262
  | Metric | mnbm | begin | qags_xsum | qags_cnndm | summeval | dialfact | paws | q2 | frank | Average |
263
  |---------|------|-------|-----------|------------|----------|----------|------|------|-------|---------|
264
+ | **AUC** | 0.71 | 0.80 | 0.83 | 0.89 | 0.84 | 0.94 | 0.88 | 0.88 | 0.90 | 0.85 |
265
+
266
+ ### Citation Information
267
+ ```
268
+ @misc{padhi2024graniteguardian,
269
+ title={Granite Guardian},
270
+ author={Inkit Padhi and Manish Nagireddy and Giandomenico Cornacchia and Subhajit Chaudhury and Tejaswini Pedapati and Pierre Dognin and Keerthiram Murugesan and Erik Miehling and Martín Santillán Cooper and Kieran Fraser and Giulio Zizzo and Muhammad Zaid Hameed and Mark Purcell and Michael Desmond and Qian Pan and Inge Vejsbjerg and Elizabeth M. Daly and Michael Hind and Werner Geyer and Ambrish Rawat and Kush R. Varshney and Prasanna Sattigeri},
271
+ year={2024},
272
+ eprint={2412.07724},
273
+ archivePrefix={arXiv},
274
+ primaryClass={cs.CL},
275
+ url={https://arxiv.org/abs/2412.07724},
276
+ }