Spearmint is a package to perform Bayesian optimization according to the algorithms outlined in the paper:  Practical Bayesian Optimization of Machine Learning Algorithms  Jasper Snoek, Hugo Larochelle and Ryan P. Adams  Advances in Neural Information Processing Systems, 2012