cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.3535/vd0-3sp-4z7
title: Tonna galea (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/m8x-a4p-86c
title: Chauvetia brunnea (Donovan, 1804)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/p2b-mrv-nxk
title: Skeneopsis planorbis (O. Fabricius, 1780)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/j5e-sbs-whf
title: Polinices Montfort, 1810

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ksr-vhr-9pz
title: Caecum glabrum (Montagu, 1803)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/bw1-cag-czz
title: Zebina sloaniana (A. d'Orbigny, 1842)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/q65-r04-qye
title: Fossarus ambiguus (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/83d-0sz-125
title: Paludinella littorina (Delle Chiaje, 1828)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ecv-s4d-07w
title: Neverita didyma (Röding, 1798)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/5hv-fvl-zrb
title: Cypraea pantherina [Lightfoot], 1786

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/jpm-7sp-0mb
title: Tornidae Sacco, 1896 (1884)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/4lw-efd-z6a
title: Terebellum terebellum (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/kb5-g80-1eg
title: Dolomena dilatata (Swainson, 1821)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/lgr-pc3-lpy
title: Nassarius megalocallus Adam & Knudsen, 1984

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.34740/kaggle/dsv/12779001
title: Full TMDB Movies Dataset 2024 (1M Movies)
DOI: 10.3535/k98-f50-lj8
title: Lampanella minima (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/vj6-s8n-wec
title: Ovatipsa chinensis (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/nr8-1lr-ctc
title: Bufonaria rana (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ysk-bfh-sg3
title: Alvania watsoni (Schwartz von Mohrenstern, 1873)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/k3q-1zs-k9m
title: Marsupina bufo (Bruguière, 1792)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/nal-9fg-0jv
title: Canarium wilsonorum (Abbott, 1967)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/hbt-jpz-mre
title: Stenomelania P. Fischer, 1885

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/mkr-ct5-5kq
title: Casmaria ponderosa (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/qkd-lsw-db1
title: Natica bibalteata G. B. Sowerby III, 1914

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/39c-xy6-pg5
title: Rissoa variabilis (Megerle von Mühlfeld, 1824)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/3hm-y4h-dpb
title: Cerithiopsis orientalis Preston, 1905

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/1kp-0j2-03p
title: Turritella maculata Reeve, 1849

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/nxy-bj4-ay3
title: Columbellidae Swainson, 1840

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/q05-pm2-2wn
title: Calyptraea Lamarck, 1799

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/w5l-8hy-gs0
title: Bolinus brandaris (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/n76-1rd-97a
title: Naria spurca (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/tnm-qv0-x1h
title: Alvania cancellata (da Costa, 1778)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/3ja-wq0-9dl
title: Naria helvola (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/4rs-02j-qs1
title: Turritella ungulina (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/25z-kff-b8k
title: Ficus gracilis (G. B. Sowerby I, 1825)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/2pa-1d4-50s
title: Buccinulum littorinoides (Reeve, 1846)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/1dm-wg8-sbm
title: Semicassis centiquadrata (Valenciennes, 1832)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/v15-06r-v3d
title: Polinices lacteus (Guilding, 1834)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/n79-cqv-hf9
title: Sinum planulatum (Récluz, 1843)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/2r9-9b0-qpw
title: Malluvium lissum (E. A. Smith, 1894)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/fzp-h9l-cqs
title: Charonia tritonis (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/nj4-6az-pzs
title: Omphalotropis ceramensis (L. Pfeiffer, 1862)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/zhw-q3b-4el
title: Pseudosimnia juanjosensii (Pérez & Gómez, 1987)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/pd3-bvw-vtr
title: Mauritia mauritiana (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/teh-vlh-3g5
title: Thiaridae Gill, 1871 (1823)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/9p5-8ld-c9p
title: Coralliophila meyendorffii (Calcara, 1845)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/t2s-g9r-s7d
title: Bostrycapulus aculeatus (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/0cn-2gm-8ck
title: Trochita trochiformis (Born, 1778)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/kh9-2z0-lhl
title: Gibberulus gibbosus (Röding, 1798)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/0s9-sjx-6cn
title: Bittium latreillii (Payraudeau, 1826)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/hl8-f26-zpw
title: Euprotomus aurisdianae (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/4zy-wz3-457
title: Canarium geelvinkbaaiense Dekkers & S. J. Maxwell, 2020

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/n0r-a81-6rk
title: Vitreolina philippi (de Rayneval & Ponzi, 1854)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/0ct-c7d-tbq
title: Columbella adansoni Menke, 1853

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/zac-4lg-fvb
title: Euprotomus iredalei (Abbott, 1960)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/nk9-8ps-rls
title: Cerithiidae J. Fleming, 1822

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/z9q-qmy-exp
title: Drupella margariticola (Broderip, 1833)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/pj1-496-6py
title: Marsupina bufo (Bruguière, 1792)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/pla-85q-6ng
title: Marsupina bufo (Bruguière, 1792)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/cxe-83d-p3r
title: Pusillina radiata (R. A. Philippi, 1836)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/e1f-g7y-y3h
title: Trivia monacha (da Costa, 1778)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/fwx-ad1-m2z
title: Merelina cheilostoma (Tenison Woods, 1877)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/7dd-lph-geg
title: Cerithium coralium Kiener, 1841

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/tyn-kdq-yyq
title: Cribrarula cribraria (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/0xf-773-7l9
title: Lithasia armigera (Say, 1821)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/l95-702-z83
title: Purpura persica (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/411-zmd-3sk
title: Nucella lapillus (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/426-a9d-ch6
title: Crepidula fornicata (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/f29-872-yjc
title: Alvania cancellata (da Costa, 1778)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/6bl-6sz-d3r
title: Canarium mutabile (Swainson, 1821)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/sqd-hre-vrw
title: Manzonia talaverai Moolenbeek & Faber, 1987

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/lq0-l8h-ndl
title: Canarium labiatum (Röding, 1798)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/sfk-bbs-k3y
title: Modulus disculus (R. A. Philippi, 1846)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/w35-tzs-m47
title: Canarium urceus (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/8dh-v7b-th3
title: Natica Scopoli, 1777

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/tn8-89r-d1h
title: Naticidae Guilding, 1834

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/44z-qdx-g1w
title: Melanoides Olivier, 1804

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/7fy-7kg-32z
title: Mauritia mauritiana (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/dnb-c4t-wk6
title: Naria turdus (Lamarck, 1810)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/xt5-v80-8w9
title: Aplus assimilis (Reeve, 1846)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/7mp-vfq-96r
title: Canarium labiatum (Röding, 1798)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/t1p-7sk-a1t
title: Mipus rosaceus (E. A. Smith, 1903)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/z9p-a7j-t8c
title: Crepidula Lamarck, 1799

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/1w7-vaa-wsy
title: Bedeva paivae (Crosse, 1864)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/1wg-rel-h42
title: Turritella cingulifera G. B. Sowerby I, 1825

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ckh-xgg-sl0
title: Cabestana africana (A. Adams, 1855)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/nn7-f1p-fkt
title: Bursa rosa (G. Perry, 1811)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/fb1-zr1-z41
title: Burnupena cincta (Röding, 1798)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/vxb-xvv-s98
title: Trivia monacha (da Costa, 1778)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/aqh-mle-bgv
title: Calpurnus verrucosus (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/eh0-h5n-dxh
title: Ovula costellata Lamarck, 1810

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/1dd-2e8-74q
title: Zonaria pyrum (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/w2w-8j7-l6h
title: Neobernaya spadicea (Swainson, 1823)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/fdf-3z6-xld
title: Erronea errones (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/391-10z-zhs
title: Trichotropis Broderip & G. B. Sowerby I, 1829

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ltx-b7d-xrk
title: Rissoa guerinii Récluz, 1843

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ezs-lxj-jpp
title: †Archimediella triplicata (Brocchi, 1814)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/yms-ph5-bzz
title: Pleurocera canaliculata (Say, 1821)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/elp-fva-s7m
title: Crepidula Lamarck, 1799

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/zel-453-h8f
title: Pleurocera Rafinesque, 1818

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/jnz-bel-75x
title: Elimia H. Adams & A. Adams, 1854

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/jxs-3zk-ls8
title: Terebellum terebellum (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/wbf-9cm-xk5
title: Rhinoclavis kochi (R. A. Philippi, 1848)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/6es-b0s-kfx
title: Alaba incerta (A. d'Orbigny, 1841)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/em5-8ke-xen
title: Cheilea equestris (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/3v4-hs8-5cx
title: Naticidae Guilding, 1834

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/z7p-klh-sdy
title: Terestrombus fragilis (Röding, 1798)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/ydq-ra8-f2y
title: Gastropoda Cuvier, 1795

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/h2m-k5n-vlg
title: Cryptonatica affinis (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/zzy-yps-fky
title: Zonaria zonaria (Gmelin, 1791)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.5281/zenodo.16882352
title: HK Content Corpus (Cantonese & Traditional Chinese)

description: This dataset contains eight cleaned source-specific corpora of Hong Kong Cantonese and Traditional Chinese text, crawled from public websites and platforms.  It was initially created for the experiments reported in https://doi.org/10.1145/3744341 which study the effect of diglossia on Hong Kong language modeling.

This dataset is also available at HuggingFace (with file extension changed to csv and header row added for HF's dataset viewer function):https://huggingface.co/datasets/SolarisCipher/hk_content_corpus

👉 This cleaned corpus is derived from a larger MySQL database used to store raw text during the data collection stage.If you need the original database for reprocessing or reproduction, please refer to:https://doi.org/10.5281/zenodo.16875235



File format: UTF-8 plain text. One line per record, separated by blank line.

Source:



Apple Daily

Hong Kong Citizen Media

Hong Kong Citizen News

InMedia.hk

LIHKG

OpenRice

Stand News

Wikipedia (zh-hk)



Intended use: training/fine-tuning language models, linguistic analysis, text clustering.


NOTE: HKNSL became effective since 2020-6-30, which can create bias on user content created afterwards. Those portion of data should be used with caution.SHA256 checksum of files:0b6ad22b7a73230fd0e44af904c0cff1773cc871417f6ad3af11a783564bca15 appledaily_article_dedup.corpus373a5b369d5e402e58760861e2bff2e618e7ee7fd4494988a39be1156f9dba84 hkcitizenmedia_article_dedup.corpus67f909cfaf7d7a67df1dc79448f24622ec525a31b73b2e3293fbaad147470e69 hkcnews_article_dedup.corpus135251f3e8ba7587018b7b2814b9ea5bbebf69c98adca73d3ea4c9f9b5571957 inmedia_article_dedup.corpus8e5e6de9c219aeccdaf13e9162b00cce2eeb7f595023a7bf19d4b5660395a3ee lihkg_posts_dedup_demoji_128.corpusdd5835a7effe49bb96a31e0c0eab43dea17ef23b3e1d9cefdc186aca276897ce openrice_review_dedup_demoji.corpus847ef0f5809481caf4bf21100e4b34207513d724dafb9f42b162ef49079e7dba thestandnews_article_dedup.corpusbd33008802797b33df8484cf1113be6a0b38547fe13515f5c4edbf4ccad270db wiki_hk.corpusIf you use this dataset, please cite the following paper, and optionally cite the dataset DOI:@article{Yung2025HKDiglossia,  author    = {Yung, Yiu Cheong and Lin, Ying-Jia and Kao, Hung-Yu},  title     = {Exploring the Effectiveness of Pre-training Language Models with Incorporation of Diglossia for Hong Kong Content},  journal   = {ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)},  volume    = {24},  number    = {7},  pages     = {71:1--71:16},  year      = {2025},  publisher = {Association for Computing Machinery},  doi       = {10.1145/3744341}}
DOI: 10.3535/07e-9rv-xz3
title: Rissoa similis Scacchi, 1836

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/kl3-44l-1vl
title: Naria spurca (Linnaeus, 1758)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.5281/zenodo.16882351
title: HK Content Corpus (Cantonese & Traditional Chinese)

description: This dataset contains eight cleaned source-specific corpora of Hong Kong Cantonese and Traditional Chinese text, crawled from public websites and platforms.  It was initially created for the experiments reported in https://doi.org/10.1145/3744341 which study the effect of diglossia on Hong Kong language modeling.

This dataset is also available at HuggingFace (with file extension changed to csv and header row added for HF's dataset viewer function):https://huggingface.co/datasets/SolarisCipher/hk_content_corpus

👉 This cleaned corpus is derived from a larger MySQL database used to store raw text during the data collection stage.If you need the original database for reprocessing or reproduction, please refer to:https://doi.org/10.5281/zenodo.16875235



File format: UTF-8 plain text. One line per record, separated by blank line.

Source:



Apple Daily

Hong Kong Citizen Media

Hong Kong Citizen News

InMedia.hk

LIHKG

OpenRice

Stand News

Wikipedia (zh-hk)



Intended use: training/fine-tuning language models, linguistic analysis, text clustering.


NOTE: HKNSL became effective since 2020-6-30, which can create bias on user content created afterwards. Those portion of data should be used with caution.SHA256 checksum of files:0b6ad22b7a73230fd0e44af904c0cff1773cc871417f6ad3af11a783564bca15 appledaily_article_dedup.corpus373a5b369d5e402e58760861e2bff2e618e7ee7fd4494988a39be1156f9dba84 hkcitizenmedia_article_dedup.corpus67f909cfaf7d7a67df1dc79448f24622ec525a31b73b2e3293fbaad147470e69 hkcnews_article_dedup.corpus135251f3e8ba7587018b7b2814b9ea5bbebf69c98adca73d3ea4c9f9b5571957 inmedia_article_dedup.corpus8e5e6de9c219aeccdaf13e9162b00cce2eeb7f595023a7bf19d4b5660395a3ee lihkg_posts_dedup_demoji_128.corpusdd5835a7effe49bb96a31e0c0eab43dea17ef23b3e1d9cefdc186aca276897ce openrice_review_dedup_demoji.corpus847ef0f5809481caf4bf21100e4b34207513d724dafb9f42b162ef49079e7dba thestandnews_article_dedup.corpusbd33008802797b33df8484cf1113be6a0b38547fe13515f5c4edbf4ccad270db wiki_hk.corpusIf you use this dataset, please cite the following paper, and optionally cite the dataset DOI:@article{Yung2025HKDiglossia,  author    = {Yung, Yiu Cheong and Lin, Ying-Jia and Kao, Hung-Yu},  title     = {Exploring the Effectiveness of Pre-training Language Models with Incorporation of Diglossia for Hong Kong Content},  journal   = {ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)},  volume    = {24},  number    = {7},  pages     = {71:1--71:16},  year      = {2025},  publisher = {Association for Computing Machinery},  doi       = {10.1145/3744341}}
DOI: 10.3535/fq4-jaf-4wm
title: Tomlinia rapulum (Reeve, 1846)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/v5e-0mc-x75
title: Rissoa ventricosa Desmarest, 1814

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/34m-91z-mk8
title: Gastropoda Cuvier, 1795

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.
DOI: 10.3535/6qx-pg4-l3h
title: Alvania discors (T. Brown, 1818)

description: Digital Specimen for the physical specimen hosted at Naturalis Biodiversity Center.