Package: bindsnet
A Python package used for simulating spiking neural networks (SNNs) on CPUs or GPUs usingPyTorchTensorfunctionality.BindsNET is a spiking neural network simulation library geared towards the development of biologically inspired algorithms for machine learning.This package is used as part of ongoing research on applying SNNs to machine learning (ML) and reinforcement learning (RL) problems in theBiologically Inspired Neural & Dynamical Systems (BINDS) lab.Check out theBindsNET experiments repositoryfor a collection of experiments, accompanying bash scripts for dispatching onCICSclusters, functions for the analysis of results, plots of experiment outcomes, and more. Documentation for the package can be foundhere.RequirementsPython 3.6requirements.txtSetting things upUsing pipBindsNET is available on PyPI. Issuepip install bindsnetto get the most recent stable release. Or, to build thebindsnetpackage from source, clone the GitHub repository, change directory to the top level of this project, and issuepip install .Or, to install in editable mode (allows modification of package without re-installing):pip install -e .To install the packages necessary to interface with theOpenAI gym RL environments library, follow their instructions for installing the packages needed to run the RL environments simulator (on Linux / MacOS).Using DockerLinkto Docker repository.We also provide a Dockerfile in which BindsNET and all of its dependencies come installed in. Issuedocker image build .at the top level directory of this project to create a docker image.To change the name of the newly built image, issuedocker tag <IMAGE_ID> <NEW_IMAGE_ID>To run a container and get a bash terminal inside it, issuedocker run -it <NEW_IMAGE_ID> bashGetting startedTo run a near-replication of the SNN fromthis paper, issuecd examples/mnist
python eth_mnist.pyThere are a number of optional command-line arguments which can be passed in, including--plot(displays useful monitoring figures),--n_neurons [int](number of excitatory, inhibitory neurons simulated),--mode ['train' | 'test'](sets network operation to the training or testing phase), and more. Run the script with the--helpor-hflag for more information.A number of other examples are available in theexamplesdirectory that are meant to showcase BindsNET's functionality. Take a look, and let us know what you think!Running the testsIssue the following to run the tests:python -m pytest test/Some tests will fail if Open AIgymis not installed on your machine.BackgroundThe simulation of biologically plausible spiking neuron dynamics can be challenging. It is typically done by solving ordinary differential equations (ODEs) which describe said dynamics. PyTorch does not explicitly support the solution of differential equations (as opposed tobrian2, for example), but we can convert the ODEs defining the dynamics into difference equations and solve them at regular, short intervals (adton the order of 1 millisecond) as an approximation. Of course, under the hood, packages likebrian2are doing the same thing. Doing this inPyTorchis exciting for a few reasons:We can use the powerful and flexibletorch.Tensorobject, a wrapper around thenumpy.ndarraywhich can be transferred to and from GPU devices.We can avoid "reinventing the wheel" by repurposing functions from thetorch.nn.functionalPyTorch submodule in our SNN architectures; e.g., convolution or pooling functions.The concept that the neuron spike ordering and their relative timing encode information is a central theme in neuroscience.Markram et al. (1997)proposed that synapses between neurons should strengthen or degrade based on this relative timing, and prior to that,Donald Hebbproposed the theory of Hebbian learning, often simply stated as "Neurons that fire together, wire together." Markram et al.'s extension of the Hebbian theory is known as spike-timing-dependent plasticity (STDP).We are interested in applying SNNs to ML and RL problems. We use STDP to modify weights of synapses connecting pairs or populations of neurons in SNNs. In the context of ML, we want to learn a setting of synapse weights which will generate data-dependent spiking activity in SNNs. This activity will allow us to subsequently perform some ML task of interest; e.g., discriminating or clustering input data. In the context of RL, we may think of the spiking neural network as an RL agent, whose spiking activity may be converted into actions in an environment's action space.We have provided some simple starter scripts for doing unsupervised learning (learning a fully-connected or convolutional representation via STDP), supervised learning (clamping output neurons to desired spiking behavior depending on data labels), and reinforcement learning (converting observations from the Atari game Space Invaders to input to an SNN, and converting network activity back to actions in the game).BenchmarkingWe simulated a network with a population of n Poisson input neurons with firing rates (in Hertz) drawn randomly from U(0, 100), connected all-to-all with a equally-sized population of leaky integrate-and-fire (LIF) neurons, with connection weights sampled from N(0,1). We varied n systematically from 250 to 10,000 in steps of 250, and ran each simulation with every library for 1,000ms with a time resolution dt = 1.0. We tested BindsNET (with CPU and GPU computation), BRIAN2, PyNEST (the Python interface to the NEST SLI interface that runs the C++NEST core simulator), ANNarchy (with CPU and GPU computation), and BRIAN2genn (the BRIAN2 front-end to the GeNN simulator).Several packages, including BRIAN and PyNEST, allow the setting of certain global preferences; e.g., the number of CPU threads, the number of OpenMP processes, etc. We chose these settings for our benchmark study in an attempt to maximize each library's speed, but note that BindsNET requires no setting of such options. Our approach, inheriting the computational model of PyTorch, appears to make the best use of the available hardware, and therefore makes it simple for practicioners to get the best performance from their system with the least effort.All simulations run on Ubuntu 16.04 LTS with Intel(R) Xeon(R) CPU E5-2687W v3 @ 3.10GHz, 128Gb RAM @ 2133MHz, and two GeForce GTX TITAN X (GM200) GPUs. Python 3.6 is used in all cases. Clock time was recorded for each simulation run.CitationIf you use BindsNET in your research, please cite the followingarticle:@ARTICLE{10.3389/fninf.2018.00089,
	AUTHOR={Hazan, Hananel and Saunders, Daniel J. and Khan, Hassaan and Patel, Devdhar and Sanghavi, Darpan T. and Siegelmann, Hava T. and Kozma, Robert},   
	TITLE={BindsNET: A Machine Learning-Oriented Spiking Neural Networks Library in Python},      
	JOURNAL={Frontiers in Neuroinformatics},      
	VOLUME={12},      
	PAGES={89},     
	YEAR={2018}, 
	URL={https://www.frontiersin.org/article/10.3389/fninf.2018.00089},       
	DOI={10.3389/fninf.2018.00089},      
	ISSN={1662-5196},
}ContributorsDaniel Saunders (email)Hananel Hazan (email)Darpan Sanghavi (email)Hassaan Khan (email)Devdhar Patel (email)LicenseGNU Affero General Public License v3.0