Package: acqdiv
ACQDIVThis repository contains the code and configuration files for transforming
the child language acquisition corpora into the ACQDIV database.PublicationIf you use the database in your reasearch, please cite as follows:Jancso, Anna, Steven Moran, and Sabine Stoll.
"The ACQDIV Corpus Database and Aggregation Pipeline."
Proceedings of The 12th Language Resources and Evaluation Conference. 2020.Link to PaperResourcesDownload the ACQDIV database (only public corpora):To request access to the full database including the private corpora (for
research purposes only!),
please refer toSabine Stoll.
In case of technical questions, please open an issue on this repository.CorporaOur full database consists of the following corpora:CorpusISOPublic# WordsChintang Language Corpusctnno987'673Cree Child Language Acquisition Study (CCLAS) Corpuscreyes44'751English Manchester Corpusengyes2'016'043MPI-EVA Jakarta Child Language Databaseindyes2'489'329Allen Inuktitut Child Language Corpusikeno71'191MiiPro Japanese Corpusjpnyes1'011'670Miyata Japanese Corpusjpnyes373'021Ku Waru Child Language Socialization Studymuxyes65'723Sarvasy Nungon Corpusyuwyes19'659Qaqet Child Language Documentationbyxno56'239Stoll Russian Corpusrusno2'029'704Demuth Sesotho Corpussotyes177'963Tuatschin Corpusrohno118'310Koç University Longitudinal Language Development Databaseturno1'120'077Pfeiler Yucatec Child Language Corpusyuano262'382Total10'843'735Running the pipelineFor Windows users, follow the installation/run instructions here:https://github.com/acqdiv/acqdiv/wiki/Installation-Run-instructions-for-WindowsFor Mac and Linux user, continue here to run the pipeline yourself:Install the packageCreate a virtual environment [optional]:python3-mvenvvenvsourcevenv/bin/activateYou can install the package from PyPI or directly from source:PyPIpip install acqdivFrom source# Clone Repositorygitclonegit@github.com:acqdiv/acqdiv.gitcdacqdiv# Install package (for users!)pipinstall.# Developer mode (for developers!)pipinstall-rrequirements.txtGet the corporaRun the following script to download the public corpora:python util/download_public_corpora.pyThe corpora are in the foldercorpora.For the private corpora, either place the session files  incorpora/<corpus_name>/{cha|toolbox}/and the metadata files (only Toolbox corpora) incorpora/<corpus_name>/imdi/or
edit the paths to those files in theconfig.ini(also see below).Generate the databaseGet the configuration filesrc/acqdiv/config.iniand specify the absolute
paths (without trailing slashes) for the corpora directory (corpora_dir) and
the directory where the database should be written to (db_dir):[.global]# directory containing corporacorpora_dir=/absolute/path/to/corpora/dir# directory where the database is written todb_dir=/absolute/path/to/database/dir...Optionally adapt the paths for the individual corpora (sessionsandmetadata_dir).Run the pipeline specifying the absolute path to the configuration file:acqdiv load -c /absolute/path/to/config.iniGenerate the R objectInstall dependencies$ R
> install.packages("RSQLite")
> install.packages("rlang")Navigate tosrc/acqdiv/databaseand run:Rscript sqlite_to_r.R /absolute/path/to/sqlite-DBRun testsRun the unittests:pytest tests/unittestsRun the integrity tests on the database:pytest tests/systemtests