bother messing with different kinds of activations don't bother trying sigmoid or tant they're they're probably not going to work out very well but different optimizers do matter atom is a great place to start it's super fast it tends to give pretty good results it has a bit of a tendency to overfit if you really are trying to squeeze the juice out of your system and you want the best results SGD is likely to get you a better result but it's going to take quite a bit more time to Verge sometimes rmsprop beats the pants