By far the cheapest way to stock your garden is to grow from seed. Another way is to take cuttings from friends plants and grow them on. Clearly this method would save a huge amount but would take a while for the plants to establish. The RHS website (https://www.rhs.org.uk/) is a good placed to start for your gardening questions.