Brown also has faced criticism from the opposition Conservative Party , which has said that Brown 's Labour Party failed to limit spending and put away savings during the economy 's boom growth over the last decade .