Package: labton
labtonWhat's this then?Labton(LABelingTOolNow!) is an OpenSource annotation tool forcreating text data sets for machine learning models. The length of the paragraphs to annotate is defined by you. Labton also allows for extraction of words in the given pargraph - thus the labels of the paragraph can be a word from the paragraph. You can also use Labton to help control Inter-Annotator Agreement (ie. securing that your annotaters agree on the defined classes).But why?This tool is thus used in order to create a labeled data set of text.
As such this library is for you if you:Are aiming to build a text-classifiaction or -extraction algorithm, and are putting together a dataset.Need high quality of the labels (secure Inter-Annotator Agreement)Want a webpage that can be used to annotate your text both on PC and smartphone.Prioritize getting up and running fast and efficiently (can be done in seconds if the data is ready)Actually wanted to useprodigybut need to do a proof a concept before spending the money;)The following is a standart structure for the development of a NLP-project:Labton is developed such that there is a painless integreation from the stages before and after the data annotation step.
This is done by making both data integration and data extration possible within the same environment ie. a python IDE such as Jupyter Notebook.How does it work?ThePython libraryincludes an easily deployable Flask web app that allows one to annotate the text in self defined classes. The app can be deployed directly from aTerminalor through aJupyter Notebookfor lighter annotation tasks. The classes, and many other aspects of the app, are easily configurable either via python or through YAML configguration files.The data can be easily uploaded to the app. This can be done by directly pointing to a .cvs file (and specifying the delimiter) or by simply feeding in a Pandas Dataframe (and specifying the text column). The app will then structure the data and present one segment at a time for human classification in the UI.How do I get started in a jupyter notebook (access localy)Firstlypip install labtonin your virtual environment of choice
From there simply open jupyter notebook and run the following from a cell.In order to test the interface, with sample data from the package, simply instantiate and run the App object without any data source or classesfrom labton.annotation_app import AppApp().run()The app should now be running atlocalhost:8080Type any name to login (no password needed for now)When you've verified that Labton is useable for your usecase you can go ahead and boot up the app with your own data like so:from labton.annotation_app import Appapp = App(data_source='<your data source>, classes=<your list of classes>)<your list of classes> is a list contatining the classes you want to classify the text into. For a tweet sentiment classifier this could look like:classes=["positive", "Negative", "Neutral"]<your data source> can either be a path to the .csv file or alternatively a pandas.DataFrame.If a it is a Datafame thecolumn_nameof the column contatining the text needs to be defined. If a .csv file only contating the text, then the delimiter of the files need to be fed to the App object ascsv_sep.
You can also set theproject_name(used when running many projects from the same environment), theport, the directory you want the config- and data files created in, along with many other setings.In order to boot up the server and start annotating simply run:app.run()The jupyter notebook will be occupied as long as the server is running.
You can start the server again and it will continue where you left from.At any point in the process you can extract a copy of the data as a pandas.DataFrame like so:from labton.labton_backend.helper_funcs import get_labton_datadf_labeled_data = get_labton_data()If you have given a your project a customproject_namehand this to theget_labton_datafunction in order to load the data from the correct database file.How do I get started with running application on server (access from internet)If you don't already have an intenet facing server I can recomend starting a free account onpythonanywhere) and booting up a server.From here simply:Go to the terminalCreate and activate a virtual environment (optional)pip install labtonorpython3 -m pip install labtonIn order to test the interface, with sample data from the package, simply go to the folder where you want to initialise the project and run the library as so:python -m labtonThis will create a folder for the config files and a folder for data base files and start the server with a few test sentances.The server can now be accessed locally for a testrun atlocalhost:8080You can now configure the YAML file found in the projects_config_files with the port, host, etc. that mathces your firewall configurations.TODO: Add easy functionality and walkthrough for how to setup a python anywhere app