Upload model
Browse files- README.md +8 -11
- config.json +5 -4
- pytorch_model.bin +1 -1
- tokenizer_config.json +1 -1
README.md
CHANGED
@@ -1,21 +1,18 @@
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
-
library_name:
|
4 |
tags:
|
5 |
-
-
|
6 |
- token-classification
|
7 |
- ner
|
8 |
- named-entity-recognition
|
9 |
pipeline_tag: token-classification
|
10 |
-
datasets:
|
11 |
-
- DFKI-SLT/few-nerd
|
12 |
-
language:
|
13 |
-
- en
|
14 |
---
|
15 |
|
16 |
# SpanMarker for Named Entity Recognition
|
17 |
|
18 |
-
This is a [SpanMarker](https://github.com/tomaarsen/SpanMarkerNER) model that can be
|
19 |
|
20 |
## Usage
|
21 |
|
@@ -25,15 +22,15 @@ To use this model for inference, first install the `span_marker` library:
|
|
25 |
pip install span_marker
|
26 |
```
|
27 |
|
28 |
-
You can then run inference
|
29 |
|
30 |
```python
|
31 |
from span_marker import SpanMarkerModel
|
32 |
|
33 |
-
# Download from
|
34 |
-
model = SpanMarkerModel.from_pretrained("
|
35 |
# Run inference
|
36 |
entities = model.predict("Amelia Earhart flew her single engine Lockheed Vega 5B across the Atlantic to Paris.")
|
37 |
```
|
38 |
|
39 |
-
See the [SpanMarker](https://github.com/tomaarsen/SpanMarkerNER) repository for documentation and additional information on this
|
|
|
1 |
+
|
2 |
---
|
3 |
license: apache-2.0
|
4 |
+
library_name: span-marker
|
5 |
tags:
|
6 |
+
- span-marker
|
7 |
- token-classification
|
8 |
- ner
|
9 |
- named-entity-recognition
|
10 |
pipeline_tag: token-classification
|
|
|
|
|
|
|
|
|
11 |
---
|
12 |
|
13 |
# SpanMarker for Named Entity Recognition
|
14 |
|
15 |
+
This is a [SpanMarker](https://github.com/tomaarsen/SpanMarkerNER) model that can be usedfor Named Entity Recognition. In particular, this SpanMarker model uses [prajjwal1/bert-tiny](https://huggingface.co/prajjwal1/bert-tiny) as the underlying encoder.
|
16 |
|
17 |
## Usage
|
18 |
|
|
|
22 |
pip install span_marker
|
23 |
```
|
24 |
|
25 |
+
You can then run inference with this model like so:
|
26 |
|
27 |
```python
|
28 |
from span_marker import SpanMarkerModel
|
29 |
|
30 |
+
# Download from the 🤗 Hub
|
31 |
+
model = SpanMarkerModel.from_pretrained("span_marker_model_name")
|
32 |
# Run inference
|
33 |
entities = model.predict("Amelia Earhart flew her single engine Lockheed Vega 5B across the Atlantic to Paris.")
|
34 |
```
|
35 |
|
36 |
+
See the [SpanMarker](https://github.com/tomaarsen/SpanMarkerNER) repository for documentation and additional information on this library.
|
config.json
CHANGED
@@ -1,5 +1,5 @@
|
|
1 |
{
|
2 |
-
"_name_or_path": "models\\bt-coarse-
|
3 |
"architectures": [
|
4 |
"SpanMarkerModel"
|
5 |
],
|
@@ -96,11 +96,12 @@
|
|
96 |
"use_cache": true,
|
97 |
"vocab_size": 30524
|
98 |
},
|
99 |
-
"entity_max_length":
|
100 |
-
"marker_max_length":
|
101 |
-
"model_max_length":
|
102 |
"model_max_length_default": 512,
|
103 |
"model_type": "span-marker",
|
|
|
104 |
"torch_dtype": "float32",
|
105 |
"transformers_version": "4.27.2",
|
106 |
"vocab_size": 30524
|
|
|
1 |
{
|
2 |
+
"_name_or_path": "models\\bt-full-coarse-1\\checkpoint-final",
|
3 |
"architectures": [
|
4 |
"SpanMarkerModel"
|
5 |
],
|
|
|
96 |
"use_cache": true,
|
97 |
"vocab_size": 30524
|
98 |
},
|
99 |
+
"entity_max_length": 8,
|
100 |
+
"marker_max_length": 128,
|
101 |
+
"model_max_length": 256,
|
102 |
"model_max_length_default": 512,
|
103 |
"model_type": "span-marker",
|
104 |
+
"span_marker_version": "1.0.0.dev",
|
105 |
"torch_dtype": "float32",
|
106 |
"transformers_version": "4.27.2",
|
107 |
"vocab_size": 30524
|
pytorch_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 17571375
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7fad7460497ee6440ffe865221630a4d1b576a9cf192ed8ef9785a500e20ea0d
|
3 |
size 17571375
|
tokenizer_config.json
CHANGED
@@ -4,7 +4,7 @@
|
|
4 |
"do_basic_tokenize": true,
|
5 |
"do_lower_case": true,
|
6 |
"mask_token": "[MASK]",
|
7 |
-
"model_max_length":
|
8 |
"never_split": null,
|
9 |
"pad_token": "[PAD]",
|
10 |
"sep_token": "[SEP]",
|
|
|
4 |
"do_basic_tokenize": true,
|
5 |
"do_lower_case": true,
|
6 |
"mask_token": "[MASK]",
|
7 |
+
"model_max_length": 1000000000000000019884624838656,
|
8 |
"never_split": null,
|
9 |
"pad_token": "[PAD]",
|
10 |
"sep_token": "[SEP]",
|