Maybe we should say "activations" instead of "values". The weights are values associated with the layer as well.