Package: augly
AugLy is a data augmentations library that currently supports four modalities (audio,image,text&video) and over 100 augmentations. Each modality’s augmentations are contained within its own sub-library. These sub-libraries include both function-based and class-based transforms, composition operators, and have the option to provide metadata about the transform applied, including its intensity.AugLy is a great library to utilize for augmenting your data in model training, or to evaluate the robustness gaps of your model! We designed AugLy to include many specific data augmentations that users perform in real life on internet platforms like Facebook's -- for example making an image into a meme, overlaying text/emojis on images/videos, reposting a screenshot from social media. While AugLy contains more generic data augmentations as well, it will be particularly useful to you if you're working on a problem like copy detection, hate speech detection, or copyright infringement where these "internet user" types of data augmentations are prevalent.To see more examples of augmentations, open the Colab notebooks in the README for each modality! (e.g. imageREADME&Colab)The library is Python-based and requires at least Python 3.6, as we use dataclasses.AuthorsJoanna Bitton— Software Engineer at Meta AIZoe Papakipos— Software Engineer at Meta AIInstallationAugLyis a Python 3.6+ library. It can be installed with:pipinstallaugly[all]If you want to only install the dependencies needed for one sub-library e.g. audio, you can install like so:pipinstallaugly[audio]Or clone AugLy if you want to be able to run our unit tests, contribute a pull request, etc:gitclonegit@github.com:facebookresearch/AugLy.git&&cdAugLy[Optional,butrecommended]condacreate-naugly&&condaactivateaugly&&condainstallpip
pipinstall-e.[all]Backwards compatibility note: In versionsaugly<=0.2.1we did not separate the dependencies by modality. For those versions to install most dependencies you could usepip install augly, and if you want to use the audio or video modalities you would install withpip install augly[av].In some environments,pipdoesn't installpython-magicas expected. In that case, you will need to additionally run:condainstall-cconda-forgepython-magicOr if you aren't using conda:sudoapt-getinstallpython3-magicDocumentationCheck out ourdocumentationon ReadtheDocs!For more details about how to use each sub-library, how to run the tests, and links to colab notebooks with runnable examples, please see the READMEs in each respective directory (audio,image,text, &video).AssetsWe provide various media assets to use with some of our augmentations. These assets include:Emojis(Twemoji) - Copyright 2020 Twitter, Inc and other contributors. Code licensed under the MIT License. Graphics licensed under CC-BY 4.0.Fonts(Noto fonts) - Noto is a trademark of Google Inc. Noto fonts are open source. All Noto fonts are published under the SIL Open Font License, Version 1.1.Screenshot Templates- Images created by a designer at Facebook specifically to use with AugLy. You can use these with theoverlay_onto_screenshotaugmentation in both the image and video libraries to make it look like your source image/video was screenshotted in a social media feed similar to Facebook or Instagram.LinksFacebook AI blog post:https://ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models/PyPi package:https://pypi.org/project/augly/Arxiv paper:https://arxiv.org/abs/2201.06494Examples:https://github.com/facebookresearch/AugLy/tree/main/examplesUses of AugLy in the wildImage Similarity Challenge- a NeurIPS 2021 competition run by Facebook AI with $200k in prizes, currently open for sign ups; also produced the DISC21 dataset, which will be made publicly available after the challenge concludes!DeepFake Detection Challenge- a Kaggle competition run by Facebook AI in 2020 with $1 million in prizes; also produced theDFDC datasetSimSearchNet- a near-duplicate detection model developed at Facebook AI to identify infringing content on our platformsCitationIf you use AugLy in your work, please cite ourArxiv paperusing the citation below:@misc{papakipos2022augly,author={Zoe Papakipos and Joanna Bitton},title={AugLy: Data Augmentations for Robustness},year={2022},eprint={2201.06494},archivePrefix={arXiv},primaryClass={cs.AI}}}LicenseAugLy is MIT licensed, as found in theLICENSEfile. Please note that some of the dependencies AugLy uses may be licensed under different terms.