should probably assert that it is > 1.
If you have only one layer, I think you will end up dividing its weights by 4, because it is both the first and the last layer.