Package: propulate
Parallel Propagator of PopulationsClickhereto watch our 3 min introduction video!WhatPropulatecan do for youPropulateis an HPC-tailored software for solving optimization problems in parallel. It is openly accessible and easy to use. Compared to a widely used competitor,Propulateis consistently faster - at least an order of magnitude for a set of typical benchmarks - and in some cases even more accurate.Inspired by biology,Propulateborrows mechanisms from biological evolution, such as selection, recombination, and mutation. Evolution begins with a population of solution candidates, each with randomly initialized genes. It is an iterative "survival of the fittest" process where the population at each iteration can be viewed as a generation. For each generation, the fitness of each candidate in the population is evaluated. The genes of the fittest candidates are incorporated in the next generation.Like in nature,Propulatedoes not wait for all compute units to finish the evaluation of the current generation. Instead, the compute units communicate the currently available information and use that to breed the next candidate immediately. This avoids waiting idly for other units and thus a load imbalance.
Each unit is responsible for evaluating a single candidate. The result is a fitness level corresponding with that candidate’s genes, allowing us to compare and rank all candidates. This information is sent to other compute units as soon as it becomes available.
When a unit is finished evaluating a candidate and communicating the resulting fitness, it breeds the candidate for the next generation using the fitness values of all candidates it evaluated and received from other units so far.Propulatecan be used for hyperparameter optimization and neural architecture search.
It was already successfully applied in several accepted scientific publications. Applications include grid load forecasting, remote sensing, and structural molecular biology.In more technical termsPropulateis a massively parallel evolutionary hyperparameter optimizer based on the island model with asynchronous propagation of populations and asynchronous migration.
In contrast to classical GAs,Propulatemaintains a continuous population of already evaluated individuals with a softened notion of the typically strictly separated, discrete generations.
Our contributions include:A novel parallel genetic algorithm based on a fully asynchronized island model with independently processing workers.Massive parallelism by asynchronous propagation of continuous populations and migration via efficient communication using the message passing interface.Optimized use efficiency of parallel hardware by minimizing idle times in distributed computing environments.To be more efficient, the generations are less well separated than they usually are in evolutionary algorithms.
New individuals are generated from a pool of currently active, already evaluated individuals that may be from any generation.
Individuals may be removed from the breeding population based on different criteria.You can find the corresponding publicationhere:Taubert, O.et al.(2023). Massively Parallel Genetic Optimization Through Asynchronous Propagation of Populations. In: Bhatele, A., Hammond, J., Baboulin, M., Kruse, C. (eds) High Performance Computing. ISC High Performance 2023. Lecture Notes in Computer Science, vol 13948. Springer, Cham.doi.org/10.1007/978-3-031-32041-5_6DocumentationCheck out the full documentation athttps://propulate.readthedocs.io/:rocket:! Here you can
find installation instructions, tutorials, theoretical background, and API references.InstallationYou can install the latest stable release from PyPI:pip install propulateIf you need the latest updates, you can also installPropulatedirectly from the master branch at you own risk.
Pull and runpip install -e .orpython setup.py develop.Propulatedepends onmpi4pyand requires an MPI implementation under the hood. Currently, it is only tested with
OpenMPI.AcknowledgmentsThis work is supported by the Helmholtz AI platform grant.