Do not flatten weights (basically just doing normal LR