Package: gama
GeneralAutomatedMachine learningAssistantAn automated machine learning tool based on genetic programming.Make sure to check out thedocumentation.GAMA is an AutoML package for end-users and AutoML researchers.
It generates optimized machine learning pipelines given specific input data and resource constraints.
A machine learning pipeline contains data preprocessing (e.g. PCA, normalization) as well as a machine learning algorithm (e.g. Logistic Regression, Random Forests), with fine-tuned hyperparameter settings (e.g. number of trees in a Random Forest).To find these pipelines, multiple search procedures have been implemented.
GAMA can also combine multiple tuned machine learning pipelines together into an ensemble, which on average should help model performance.
At the moment, GAMA is restricted to classification and regression problems on tabular data.In addition to its general use AutoML functionality, GAMA aims to serve AutoML researchers as well.
During the optimization process, GAMA keeps an extensive log of progress made.
Using this log, insight can be obtained on the behaviour of the search procedure.
For example, it can produce a graph that shows pipeline fitness over time:Note: we temporarily disabled support for the GAMA Dashboard, we will add out-of-the-box visualization again later this year.Installing GAMAYou can install GAMA with pip:pip install gamaMinimal ExampleThe following example uses AutoML to find a machine learning pipeline that classifies breast cancer as malign or benign.
See the documentation for examples inclassification,regression,
usingARFF as input.fromsklearn.datasetsimportload_breast_cancerfromsklearn.model_selectionimporttrain_test_splitfromsklearn.metricsimportlog_loss,accuracy_scorefromgamaimportGamaClassifierif__name__=='__main__':X,y=load_breast_cancer(return_X_y=True)X_train,X_test,y_train,y_test=train_test_split(X,y,stratify=y,random_state=0)automl=GamaClassifier(max_total_time=180,store="nothing")print("Starting `fit` which will take roughly 3 minutes.")automl.fit(X_train,y_train)label_predictions=automl.predict(X_test)probability_predictions=automl.predict_proba(X_test)print('accuracy:',accuracy_score(y_test,label_predictions))print('log loss:',log_loss(y_test,probability_predictions))# the `score` function outputs the score on the metric optimized towards (by default, `log_loss`)print('log_loss',automl.score(X_test,y_test))note: By default, GamaClassifier optimizes towardslog_loss.CitingIf you want to cite GAMA, please useour ECML-PKDD 2020 Demo Track publication.@InProceedings{10.1007/978-3-030-67670-4_39,
author="Gijsbers, Pieter and Vanschoren, Joaquin",
editor="Dong, Yuxiao
and Ifrim, Georgiana
and Mladeni{\'{c}}, Dunja
and Saunders, Craig
and Van Hoecke, Sofie",
title="GAMA: A General Automated Machine Learning Assistant",
booktitle="Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track",
year="2021",
publisher="Springer International Publishing",
address="Cham",
pages="560--564",
abstract="The General Automated Machine learning Assistant (GAMA) is a modular AutoML system developed to empower users to track and control how AutoML algorithms search for optimal machine learning pipelines, and facilitate AutoML research itself. In contrast to current, often black-box systems, GAMA allows users to plug in different AutoML and post-processing techniques, logs and visualizes the search process, and supports easy benchmarking. It currently features three AutoML search algorithms, two model post-processing steps, and is designed to allow for more components to be added.",
isbn="978-3-030-67670-4"}LicenseThe contents of this repository is under anApache-2.0 License.