In a way, neurons in the brain are either on or off by either firing an action potential or not firing an action potential. This is because a neuron is constantly getting information from other cells through synaptic contacts. Information traveling across a synapse does NOT always result in a action potential. Rather, this information alters the chance that an action potential will be produced by raising or lowering the threshold of the neuron. Both have a memory that can grow.
Computer memory grows by adding computer chips.
Memories in the brain grow by stronger synaptic connections. Both can adapt and learn. It is much easier and faster for the brain to learn new things. For example, try counting backwards and multiplying 2 numbers at the same time. However, the brain also does some multitasking using the autonomic nervous system .