A home with setbacks will be surrounded by several small patches of lawn or garden which may require a lot of work for minimal returns.
A home built right along the property line can have one large outdoor area, which is why such structures are sometimes called garden, patio, or narrow-lot homes.