semvec/pypi-packages huggingface dataset:
refs-nb 1.0.0
Fast Naive Bayes classifier for reference detection in scientific text.
License: Apache-2.0
Requires Python: >=3.8

# refs_nb

🤔 Classify if a text chunk is a reference!

A fast, lightweight Naive Bayes classifier for determining whether a chunk of scientific text is a bibliographic reference or main text.

- Input: Any text chunk (sentence, paragraph, or block)
- Output: "reference" or "main_text" label, with confidence score

Ideal for preprocessing, data cleaning, or automated sectioning in scientific document analysis.

## Usage

```python
from refs_nb import predict

predictions, probs = predict(
    ["text 1.", "text 2.", "...."],
)
```

## How the model was trained
See: https://www.kaggle.com/code/happylongliveduck/train-maintext-references-classification/notebook

## Attribution

This model/package was trained using the **CC-BY licensed subset** of CORD-19 dataset. The original authors of the papers are credited in the CORD-19 metadata. For more information, please see the CORD-19 dataset and its license terms:
https://www.kaggle.com/allen-institute-for-ai/CORD-19-research-challenge