|
--- |
|
license: cc-by-nc-sa-4.0 |
|
language: |
|
- cs |
|
- de |
|
pipeline_tag: text2text-generation |
|
tags: |
|
- code |
|
- wikibase |
|
- vital records |
|
base_model: google/mt5-small |
|
inference: |
|
parameters: |
|
max_new_tokens: 200 |
|
--- |
|
|
|
A model for connverting vital records to Wikibase. Trained on a transcription dataset obrained with HTR (<a href="https://gitlab.com/scripta/escriptorium">eScriptorium</a>) from 150 pages of the Jewish registry book <a href="https://vademecum.nacr.cz/vademecum/permalink?xid=8c9e996c-e65c-41a0-8cbc-f8fc8dc32468">HBMa 2501</a> (<a href="https://www.wikidata.org/wiki/Q108724909">Wikidata</a>). The dataset contains 1071 vital records, which were uploaded to <a href="https://matrika.wikibase.cloud">Wikibase Cloud</a> after processing using this model. |
|
|
|
Based on <a href="https://huggingface.co/google/mt5-small">Google's mT5</a>. |
|
|
|
<h3>Processing ditto marks</h3> |
|
|
|
<pre> |
|
mt5prefix = "dto" |
|
upperCell = "18 Juny 1858 H. Barb. Kohn" |
|
lowerCell = "dto dto H. Ros. Plowitz" |
|
dataset_input = f"{mt5prefix}:{upperCell}|{lowerCell}" |
|
dataset_target = "18 Juny 1858 H. Ros. Plowitz" |
|
</pre> |
|
|
|
<h3>Processing a table cell</h3> |
|
|
|
<pre> |
|
mt5prefix = "wbPre" |
|
header = "Namen des Vaters mit Anführung des Standes, ob Familiant od. Gewerbsmann, u. seines Wohnortes, Schutzdom. Haus-Nr. und bei ehelichen Geburten seines Gubernial-Ehekonsenses Datum und Zahl" |
|
cell = "Markus Gibianer, Lederhändler, S. d. Seligmann Gibianer u. der Magdalena geb. Motz" |
|
dataset_input = f"{mt5prefix}:{header}|{cell}" |
|
dataset_target = "[[<a href="https://matrika.wikibase.cloud/wiki/Property:P23">P23</a>:Markus Gibianer|<a href="https://matrika.wikibase.cloud/wiki/Property:P26">P26</a>:Lederhändler]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P27">P27</a>:Seligmann Gibianer]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P28">P28</a>:Magdalena Gibianer geb. Motz]]" |
|
</pre> |
|
|
|
<h3>Processing a whole record</h3> |
|
|
|
<pre> |
|
mt5prefix = "wbDef" |
|
input_string = "[[<a href="https://matrika.wikibase.cloud/wiki/Property:P5">P5</a>:60]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P6">P6</a>:1865-05-05]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P7">P7</a>:H. Charlotte Löw]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P12">P12</a>|DD:23]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P12">P12</a>|MM:04]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P12">P12</a>|YY:1865]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P14">P14</a>|<a href="https://matrika.wikibase.cloud/wiki/Property:P8">P8</a>:1061/2]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P14">P14</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q8">Q8</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P15">P15</a>|DD:06]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P15">P15</a>|MM:05]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P15">P15</a>|YY:1865]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P16">P16</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q22">Q22</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P17">P17</a>:Friederika]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P20">P20</a>:4]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P21">P21</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q13">Q13</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P22">P22</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q15">Q15</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P23">P23</a>:Jakob Raubitschek|<a href="https://matrika.wikibase.cloud/wiki/Property:P26">P26</a>:Eisenhändler]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P27">P27</a>:Josef Raubitschek]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P28">P28</a>:Theresia Raubitschek geb. Latus]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P24">P24</a>:Pauline XXX]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P29">P29</a>:Markus Raudnitz]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P30">P30</a>:Rachel Raudnitz geb. Kuh]]" |
|
dataset_input = f"{mt5prefix}:{input_string}" |
|
dataset_target = "[[<a href="https://matrika.wikibase.cloud/wiki/Property:P12">P12</a>:1865-04-23]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P14">P14</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q8">Q8</a>|<a href="https://matrika.wikibase.cloud/wiki/Property:P8">P8</a>:1061/2]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P15">P15</a>:1865-05-06]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P16">P16</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q22">Q22</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P17">P17</a>:Friederika]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P18">P18</a>:Raubitschek]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P19">P19</a>:Friederika Raubitschek]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P1">P1</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q1">Q1</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P20">P20</a>:4]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P21">P21</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q13">Q13</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P22">P22</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q15">Q15</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P23">P23</a>:Jakob Raubitschek|<a href="https://matrika.wikibase.cloud/wiki/Property:P26">P26</a>:Eisenhändler]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P24">P24</a>:Pauline Raubitschek]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P27">P27</a>:Josef Raubitschek]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P28">P28</a>:Theresia Raubitschek geb. Latus]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P29">P29</a>:Markus Raudnitz]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P30">P30</a>:Rachel Raudnitz geb. Kuh]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P33">P33</a>:Charlotte Löw]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P38">P38</a>:<a href="https://matrika.wikibase.cloud/wiki/Item:Q170">Q170</a>]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P5">P5</a>:60]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P6">P6</a>:1865-05-05]] [[<a href="https://matrika.wikibase.cloud/wiki/Property:P7">P7</a>:H. Charlotte Löw]]" |
|
</pre> |
|
|
|
|