VinBigData ASR VLSP 2020

100 hours of speech data in Vietnamese provided by VinBigData for the VLSP ASR Challenge 2020

Yes - it has a direct download link or links


Recolecta

RECOLECTA, or Open Science Collector, is the national aggregator of open access repositories. This platform brings together all the Spanish digital infrastructures in which open access research results are published and/or deposited.

Fundación Española para la Ciencia y Tecnología (FECYT)


SCImago Journal Rank

The SCImago Journal & Country Rank is a publicly available portal that includes the journals and country scientific indicators developed from the information contained in the Scopus® database (Elsevier B.V.). These indicators can be used to assess and analyze scientific domains. Journals can be compared or analysed separately. Country rankings may also be compared or analysed separately. Journals can be grouped by subject area (27 major thematic areas), subject category (313 specific subject categories) or by country. Citation data is drawn from over 34,100 titles from more than 5,000 international publishers and country performance metrics from 239 countries worldwide. The SJCR allows you also to embed significative journal metrics into your web as a clickable image widget

This platform takes its name from the SCImago Journal Rank (SJR) indicator (PDF), developed by SCImago from the widely known algorithm Google PageRank™. This indicator shows the visibility of the journals contained in the Scopus® database from 1996.

SCImago is a research group from the Consejo Superior de Investigaciones Científicas (CSIC), University of Granada, Extremadura, Carlos III (Madrid) and Alcalá de Henares, dedicated to information analysis, representation and retrieval by means of visualisation techniques.

As well as the SJR Portal, SCImago has developed The Shape of Science, the SIR (SCImago Institution Rankings) and the Atlas of Science. The Shape of Science is an information visualization project whose aim is to reveal the structure of science. Its interface has been designed to access the bibliometric indicators database of the SCImago Journal & Country Rank portal.The SIR is a classification of academic and research-related institutions ranked by a composite indicator that combines three different sets of indicators based on research performance, innovation outputs and societal impact measured by their web visibility. The Atlas of Science project proposes the creation of an information system whose major aim is to achieve a graphic representation of IberoAmerican Science Research. Such representation is conceived as a collection of interactive maps, allowing navigation functions throughout the semantic spaces formed by the maps.

No - but the current owners/custodians have contact information for data queries

unknown: License information unavailable


newspaper in Basque of a region

It is a Basque language magazine published by the Goiena Communication Group in the Debagoiena region of Gipuzkoa.

Creative Commons Aitortu-Partekatu

2011ko ekainaren 27tik aurrerako goiena.eus-eko testuak lizentzia honekin daude babestuak: Creative Commons Aitortu-Partekatu, cc-by-sa. Iritzigileek, erantzunetan mezua lagatzen dutenek, argazkiak igotzen dituztenek... edozer bidaltzen dutela ere, lizentzia hau esleitzen diotela onartu behar dute. Hala ere, goiena.eus-ek ez ditu salbuespenak baztertzen eta, gertatzen badira, testu horiek argitaratzen direnean argi zehaztuko da hori. Jarri gurekin harremanetan kontaktu orriaren bidez hemen argitaratu nahi dituzun testuak salbuespen horien artean sartu behar direla uste baduzu. Blog komunitateko blog bakoitzak du jabe bat eta salbuetsita daude goiena.eus-eko lizentziapetik.

CC-by-sa laburdurak Creative Commons Aitortu-Partekatu lizentzia adierazten du. Definizio gehientsuenen arabera, eduki librea edo/eta copyleft terminoak aplika dakizkieke hemengo CC-by-sa testuei. Era berean, lizentzia honek Approved for Free Cultural Use etiketa darama, Erabilpen Kultural Librerako Baimendua. Etiketa hori Creative Commons erakundeak aukeratutako termino bat da, Wikipediarekin eta eduki libreen munduarekin bateragarria den edukia zehatz definitzeko sortua. The Open Knowledge Foundation delakoak argitaratutako Jakintza askearen definizioan ere (testua euskaraz) sartzen da gure lizentzia.

Funtsean honek zera esan nahi du: edonork erabil ditzake hemen agertzen diren testuak. Eskubidea duzu:
• Hemengo testuak norberak nahi duen tokian berrargitaratzeko.
• Testuen kopiak egiteko.
• Testuotan oinarritutako lan eratorriak egiteko, erabilpen komertzialak barne (liburu batean bildumaren bat egiteko, adibidez).
• Testuak, argazkiak, bideoak... erabiltzeko euskarazko Wikipedian artikuluak dokumentatzeko, hemen deskribatutako prozesua bururaino iristen denean.

Baina eskubide horiekin batera, betebeharrak daude:
• Egiletza aitortu behar duzu. Artikuluaren sinatzaileari zor zaio egiletza hori eta baita Goienari ere.
• Baldintza berean banatu behar duzu lan eratorria edo egiten duzun kopia edo dena delakoa.

Egiletza aitortu eta lizentziaren baldintzekin zuzen jokatzeko modu zuzen bat izan daiteke erabiltzaile izena aipatzea, lizentziaren aipu eta lotura eskaintzea. Adibidez, paperean inprimatuko bazenu, honela:
© Jose Maria Arizmendiarrieta
cc-by-sa Creative Commons Aitortu Partekatu
http://creativecommons.org/licenses/by-sa/3.0/deed.eu
goiena.eus-etik hartua: http://goiena.eus/xxxx-xxxx-xxxx

Interneten bada, estekak eginda URL horiekin:
© cc-by-sa Jose Maria Arizmendiarrieta: Creative Commons Aitortu-Partekatu. Hemendik hartua: goiena.eus

Aitortza eta eskubideak artikulugileei zor zaizkiela uste dugu, baina goiena.eus-eko jatorria aipatzea zuzena eta jatorra izango litzateke, eta eskertuko dizugu.

cc-by-3.0: Creative Commons Attribution 3.0 Unported


Yoruba dialogues in different domains

Yoruba dialogues in different domains curated from two sources: https://coerll.utexas.edu/yemi/pdfs/YorubaYeMi-textbook.pdf and https://www.theyorubablog.com/bibe-eko-wo-fun-ose-kan-one-week-visit-in-lagos

World-Wide
Nigeria
United States of America

cc-by-3.0-us: Creative Commons Attribution 3.0 United States


Baidu baike

Baidu Baike (/ˈbaɪduː ˈbaɪkə/; Chinese: 百度百科; pinyin: Bǎidù Bǎikē; lit. 'Baidu Encyclopedia', also known as Baidu Wiki[2]) is a Chinese-language collaborative online encyclopedia owned by the Chinese technology company Baidu.[1] It was launched in April 2006.[1] As of November 2019, it had 16 million entries and more than 6.9 million editors.


BanglaLM: Bangla Corpus For Language Model Research

A dataset that contains Bangla corpus for training unsupervised ML model, and it contains around 40GB of text data containing 3 versions of this dataset. This is around a 20 million sample size dataset. The title for the paper "BanglaLM: Bangla Corpus for Language Model Research"
The work was done in collaboration with researchers from Stevens Institute of Technology, Western Carolina University, Florida Atlantic University, Noakhali Science and Technology University, and Hajee Mohammad Danesh Science and Technology University, and has been accepted for publication at ICIRCA 2021.

Contents of this repository are restricted to only non-commercial research purposes under the Creative Commons Attribution 4.0 International License. Copyright of the dataset contents belongs to the original copyright holders.

Cite this dataset👍

@inproceedings{kowsher-etal-2021-banglalm,
    title = "BanglaLM: Bangla Corpus for Language Model Research",
    author ="Kowsher, Md. and
     Uddin, Md.Jashim and
     Tahabilder, Anik and
     Ruhul Amin, Md and
     Shahriar, Md. Fahim and
     Sobuj, Md. Shohanur Islam
     ",

    conference = "International conference on inventive research in computing applications (ICIRCA)",
    month = "September",
    year = "2021",
    address = "Online",
    publisher = "IEEE",
    url = "https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3882903"
}

cc-by-4.0: Creative Commons Attribution 4.0 International

No - the dataset curators describe the primary sources but they are fully private


BBC Hausa

BBC Hausa is the Hausa language service of BBC World Service meant primarily for the Hausa-speaking world in Nigeria, Ghana, Niger and the rest of Hausa speakers in West Africa. It is part of BBC foreign language output of 33 languages, of which five are African languages. The language service include radio station, Abuja bureau office and daily updated website which serves as a news portal and provides information as well as analyses in text, audio and video and provides online access to radio broadcasts. The radio service is broadcast from Broadcasting House in London and preliminary editing done at BBC bureau office in Abuja

Site Terms of Use

The BBC provides access to bbc.co.uk 'in the UK and in various parts of the world (users outside the UK can see advertisements on other sites operated by the BBC BBC Worldwide Limited (BBCW) based on the following criteria:

Use of this site signifies that you agree to the terms of this Act as soon as you sign in to bbc.co.uk. If you do not agree to these terms, do not access or use bbc.co.uk.

The BBC may change these terms from time to time so you should check these terms regularly. Your continued use of bbc.co.uk constitutes your acceptance of these Terms of Use and Privacy Policy. If you do not agree with the changes - the changes have been made, then stop using the site. If there are any discrepancies between these terms and any terms contained in a bbc.co.uk website in your area, then the terms of your domain are in advance.


Spotify Podcast Dataset

Podcasts are a rapidly growing audio-only medium that involve new patterns of usage and new communicative conventions and motivate research in many new directions.To facilitate such research, we present the Spotify English-Language Podcast Dataset.

This dataset consists of 100,000 episodes from different podcast shows on Spotify. The dataset is available for research purposes.

The dataset was initially created for use in the the TREC Podcasts Track shared tasks. Participants were asked to work on two tasks focusing on understanding podcast content, and enhancing the search functionality within podcasts.

We are releasing this dataset more widely to facilitate research on podcasts through the lens of speech and audio technology, natural language processing, information retrieval, and linguistics. The dataset contains about 50,000 hours of audio, and over 600 million transcribed words. The episodes span a variety of lengths, topics, styles, and qualities.

Yes - their documentation/homepage/description is available

Yes - the dataset curators have obtained consent from the source material owners


Human Instructions in Indonesian Extracted from wikiHow

Step-by-step instructions in Indonesian extracted from wikiHow and decomposed into a formal graph representation in RDF.

This is one of multiple dataset repositories for different languages.
For more information, additional resources, and other versions of these instructions in other languages see the main Kaggle dataset page:

https://www.kaggle.com/paolop/human-instructions-multilingual-wikihow


The Stacks Project

About
The Stacks project is an ever growing open source textbook and reference work on algebraic stacks and the algebraic geometry needed to define them. Here are some quick facts:

The Stacks project is not an introductory text. It is written for graduate students and researchers in algebraic geometry.

The aim is to build algebraic geometry and use this in laying the foundations for algebraic stacks. The theory of commutative algebra, schemes, varieties, and algebraic spaces forms an integral part of the Stacks project.

The Stacks project has a maintainer (currently Aise Johan de Jong) who accepts changes etc. proposed by contributors. Everyone is encouraged to participate.

The Stacks project is meant to be read online. Consequently we do not worry about length of the chapters, etc. With hyperlinks and the search function it is possible to quickly browse through the chapters to find the lemmas, theorems, etc. that a given result depends on.

We use tags to identify results, which are permanent identifiers for a result. You can read more about this on the tags explained page.

gfdl-1.2-no-invariants-only: GNU Free Documentation License v1.2 only - no invariants


kumparan.com

Launched in 2017, kumparan is an Indonesia's Leading Digital News Media Platform. Leveraging data and innovation to deliver fresh content to millions of readers daily through world-class storytelling and journalism.

No - we would need to spontaneously reach out to the current owners/custodians


UIT-VSFC (version 1.0) - Vietnamese Students’ Feedback Corpus

Students’ feedback is a vital resource for the interdisciplinary research involving the combining of two different research fields between sentiment analysis and education. Vietnamese Students’ Feedback Corpus (UIT-VSFC) is the resource consists of over 16,000 sentences which are human-annotated with two different tasks: sentiment-based and topic-based classifications.

Paper: Kiet Van Nguyen, Vu Duc Nguyen, Phu Xuan-Vinh Nguyen, Tham Thi-Hong Truong, Ngan Luu-Thuy Nguyen, UIT-VSFC: Vietnamese Students' Feedback Corpus for Sentiment Analysis, 2018 10th International Conference on Knowledge and Systems Engineering (KSE 2018), November 1-3, 2018, Ho Chi Minh City, Vietnam.

The corpus of the two tasks is publicly available for the research purpose at the NLP@UIT group’s website1


Vanguard daily media

Vanguard Media Limited, publishers of Vanguard Newspapers was established in 1984 by Mr. Sam Amuka (a renowned, veteran journalist and columnist of the Sad Sam Fame.  Sam Amuka was editor of Sunday Times and the First Managing Director of the Punch Newspaper.) He is from Itsekiri land  in the present Delta State of Nigeria.
As at today, the paper has on its stable, the Daily Vanguard, Saturday Vanguard and Sunday Vanguard.  It has since added other titles taken care of specialised interests. These include: Financial Vanguard, Allure, Sweet Crude, Hitech, Sports Vanguard and Cyber life.  These titles  are so-product specific that no serious policy maker, businessman, Politician, student and/or interests groups would ignore.


Aaj Tak

Hindi news production


SciELO – Scientific Electronic Library Online

SciELO (Scientific Electronic Library Online) is a bibliographic database, digital library, and cooperative electronic publishing model of open access journals. SciELO was created to meet the scientific communication needs of developing countries and provides an efficient way to increase visibility and access to scientific literature. Originally established in Brazil in 1997, today there are 16 countries in the SciELO network and its journal collections: Argentina, Bolivia, Brazil, Chile, Colombia, Costa Rica, Cuba, Ecuador, Mexico, Paraguay, Peru, Portugal, South Africa, Spain, Uruguay, and Venezuela.

SciELO was initially supported by the São Paulo Research Foundation (FAPESP) and the Brazilian National Council for Scientific and Technological Development (CNPq), along with the Latin American and Caribbean Center on Health Sciences Information (BIREME). SciELO provides a portal that integrates and provides access to all of the SciELO network sites. Users can search across all SciELO collections or limit the search by a single country collection, or browse by subject area, publisher, or journal title.


Forbes Whale Media

Forbes is an American business magazine owned by Integrated Whale Media Investments and the Forbes family. Published eight times a year, it features articles on finance, industry, investing, and marketing topics. Forbes also reports on related subjects such as technology, communications, science, politics, and law. Its headquarters is located in Jersey City, New Jersey. competitors in the national business magazine category include Fortune and Bloomberg Businessweek. Forbes has an international edition in Asia as well as editions produced under license in 27 countries and regions worldwide.

The magazine is well known for its lists and rankings, including of the richest Americans (the Forbes 400), of the America's Wealthiest Celebrities, of the world's top companies (the Forbes Global 2000), Forbes list of The World's Most Powerful People, and The World's Billionaires.[4] The motto of Forbes magazine is "Change the World".[5] Its chair and editor-in-chief is Steve Forbes, and its CEO is Mike Federle.[6] In 2014, it was sold to a Hong Kong-based investment group, Integrated Whale Media Investments.


berria

Basque newspaper

cc-by-sa-2.0: Creative Commons Attribution Share Alike 2.0 Generic


CBS News Service

CBS News is the news division of the American television and radio service CBS. CBS News television programs include the CBS Evening News, CBS Mornings, news magazine programs CBS News Sunday Morning, 60 Minutes, and 48 Hours, and Sunday morning political affairs program Face the Nation. CBS News Radio produces hourly newscasts for hundreds of radio stations, and also oversees CBS News podcasts like The Takeout Podcast. CBS News also operates the 24-hour digital news network CBSN.

Up until April 2021, the president and senior executive producer of CBS News was Susan Zirinsky, who assumed the role on March 1, 2019. Zirinsky, the first female president of the network's news division, was announced as the choice to replace David Rhodes on January 6, 2019. The announcement came amid news that Rhodes would step down as president of CBS News "amid falling ratings and the fallout from revelations from an investigation into sexual misconduct allegations" against CBS News figures and Rhodes.

Northern America
United States of America


web | news or magazine website
web | social media


Everyday Health Group Digital Media

Everyday Health’s passionate, award-winning editorial team is committed to supporting you in your journey to live a healthy life each and every day. By adhering to the highest standards for accuracy, objectivity, and balance, we create trustworthy content based on up-to-date, evidence-based health and medical information and real world patient and clinician experience to help inform you how to take control of your health. Our content, including articles, graphics, videos, tools, and more, is created by experienced and accredited health journalists with valuable input from our Health Expert Network.


Aljazeera Media Network

Al Jazeera is an independent news organisation funded in part by the Qatari government. In 2006, Al Jazeera Satellite Network was changed to a public utility, private corporation by a public memorandum and articles of association in accordance with the provisions of Qatar Law No. 21 of 2006, and was re-named “Al Jazeera Media Network”.
Thus, it is a private corporation established for the public benefit. The Board of Directors of Al Jazeera Media Network issues directives, decisions and related regulations.


MALINDOMorph: Morphological dictionary and analyser for Malay/Indonesian

Malay/Indonesian lacked an open wide-coverage dictionary that can be used for both NLP tasks and non-NLP purposes. The MALINDO Morph morphological dictionary is the first such dictionary. It provides morphological information (root, prefix, suffix, circumfix, reduplication) for roughly 232K surface forms. The entry forms are those found in the authoritative dictionaries in Malaysia (Kamus Dewan4) and Indonesia (Kamus Besar Bahasa Indonesia5) (core dictionary) as well as frequent words in the Leipzig Corpora Collection (Goldhahn et al., 2012) (expanded dictionary). The morphological analyses were checked by hand for all surface forms, except for (i) basic and di-forms in the expanded dictionary whose existence is predicted from the corresponding meN-active forms in the core dictionary and (ii) the case variants of the items in the core dictionary. This paper also discusses the morphological analyser that we developed to create our morphological dictionary. Our morphological analyser is more linguistically rigorous than previous morphological analysers and stemmers/lemmatizers such as MorphInd (Larasati et al., 2011) because it takes into account circumfixes, which have previously been neglected, largely due to a misunderstanding among NLP researchers that circumfixes are no more than combinations of a prefix and a suffix.


Clarín - Argentina

Is the largest newspaper in Argentina and the second most circulated in the Spanish-speaking world.

Latin America and the Caribbean
Argentina

Se permite únicamente un uso personal e intransferible de las claves de acceso a los Sitios. Todos los contenidos de los Sitios pertenecen a AGEA o, en su caso, a terceras personas y están protegidos por la legislación sobre propiedad intelectual. Ningún contenido de los Sitios, cualquiera que sea su naturaleza, podrá ser bajado, publicado, emitido, retransmitido directa o indirectamente en ningún medio o soporte para uso distinto del estrictamente personal. Por tanto, queda terminantemente prohibida su utilización con fines comerciales, su distribución, así como su modificación, alteración o descompilación. Al acceder a los Sitios el Usuario acepta no vender, no publicar, no distribuir, no retransmitir ni facilitar ningún acceso a los contenidos de los Sitios a terceros. El Usuario acepta no utilizar los Sitios para ningún propósito ilegal.AGEA se reserva el derecho de restringir o cancelar el acceso a los Sitios si, a su criterio y consideración, el Usuario utiliza los Sitios para infringir alguna ley, violar derechos de terceros o incumplir las presentes condiciones de contratación. En caso de producirse descargas masivas de contenidos por parte de un Usuario, AGEA se reserva el derecho de cancelar el acceso a los Sitios de dicho Usuario, anular su suscripción, y/o adoptar las acciones legales que estime oportunas.Asimismo, AGEA no se responsabiliza por los nombres de Usuarios que afectan a personas ajenas, están protegidos por marcas registradas u otras leyes o que resultaren vulgares u ofensivos. Los Usuarios aceptan y reconocen que AGEA no controla, ni supervisa, ni asume responsabilidad alguna por la calidad, seguridad, características y demás elementos de los productos y/o servicios promocionados u ofrecidos en los Sitios.Asimismo, aceptan y reconocen que AGEA no controla, ni supervisa, ni asume responsabilidad acerca de la veracidad y exactitud de la descripción efectuada por aquellos que promocionan u ofrecen sus productos o servicios (en adelante los "Oferentes"), ni acerca del cumplimiento de los requisitos legales para ofrecer y vender los productos o servicios, ni sobre la capacidad y legitimación de los Oferentes para promocionar, ofrecer y/o vender sus bienes o servicios. El material publicitario es propiedad de los solicitantes del espacio. AGEA no es responsable del contenido y al respecto rigen las mismas exclusiones que para el material editorial.


Kaskus.co.id Indonesian Forum

Launched in 1999, Kaskus is an Indonesian Internet forum that describes itself as "the largest Indonesian community".


OpenITI

A corpus of Arabic texts that collected from Islamic books from different websites.

Southern Asia
Western Europe
Northern America
Pakistan
Austria
Germany
United States of America

Matthew Thomas Miller (University of Maryland, College Park), Maxim G. Romanov (University of Vienna), Sarah Bowen Savant (Aga Khan University—ISMC, London).

By exercising the Licensed Rights (defined below), You accept and agree to be bound by the terms and conditions of this Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International Public License ("Public License"). To the extent this Public License may be interpreted as a contract, You are granted the Licensed Rights in consideration of Your acceptance of these terms and conditions, and the Licensor grants You such rights in consideration of benefits the Licensor receives from making the Licensed Material available under these terms and conditions.

cc-by-nc-sa-4.0: Creative Commons Attribution Non Commercial Share Alike 4.0 International


AI4Bharat is a voluntary community founded by uMitesh Khapra and Pratyush Kumar. Both are faculty members at the Computer Science and Engineering department at Indian Institute of Technology, Madras. AI4Bharat is built around four functions: Discover, Educate, Build and Comment. We believe that the pace of innovation in AI for good can be significantly increased by systematising the process of problem discovery and solution engineering.

Indic Assamese Bengali Gujarati Hindi Kannada Malayalam Marathi Odia Punjabi Telugu Tamil Urdu English


Catalan General Crawling

The Catalan General Crawling Corpus is a 435-million-token web corpus of Catalan built from the web. It has been obtained by crawling the 500 most popular .cat and .ad domains during July 2020. It consists of 434.817.705 tokens, 19.451.691 sentences and 1.016.114 documents. Documents are separated by single new lines. It is a subcorpus of the Catalan Textual Corpus.


detik.com

Detikcom (stylized as detikcom) is an Indonesian digital media company owned by CT Corp subsidiary Trans Media. Detikcom is an online news portal and publishes breaking news. The portal is consistently ranked among Indonesia's 10 most-visited websites and is among the top 250 in the world. It receives approximately 180 million visits per day.


wikiHow Vietnamese Human Instructions

Step-by-step instructions in Vietnamese extracted from wikiHow and decomposed into a formal graph representation in RDF. For any queries and requests contact: Paolo Pareti
To cite this dataset use:
Paula Chocron, Paolo Pareti. Vocabulary Alignment for Collaborative Agents: a Study with Real-World Multilingual How-to Instructions.
(PDF) (bibtex)

cc-by-nc-4.0: Creative Commons Attribution Non Commercial 4.0 International

Yes - the dataset has the same license as the source material


Tashkeela

The dataset collected from 97 books in both modern and classic arabic. The dataset contains Arabic diacritics. The dataset is

gpl-2.0: GNU General Public License v2.0 only


Boy Genius Report BGR

BGR is a leading online destination for news and commentary focused on the mobile and consumer electronics markets. It is America’s #1 source of exclusive and breaking mobile news, and a technology category leader among early adopters, savvy technophiles and casual readers alike.

BGR started as a column written by Internet personality Jonathan Geller on the popular consumer electronics blog Engadget. Geller, known only as “Boy Genius” at the time, quickly rose to Internet stardom as he became one of the biggest draws on Engadget. At age 19, Geller spun off his column into a website devoted to bringing exclusive mobile and gadget news to the masses — and Boy Genius Report was born.


Global Recordings

Recordings for evangelism and basic Bible teaching in 6268 speech varieties.