On the minus side, the difficulty of policing public space means there may well be more irresponsible behavior there. A society that permits both public and private spaces that has public and private roads competing with each other, for example allows individuals to make the trade-off for themselves. If you want the freedom to drive your motorcycle in the nude, with a howitzer strapped to your back, and you're willing to put up with a greater risk of irresponsible behavior from others, take the public road. If you prefer greater security, and are willing to obey a few more rules and suffer some invasion of privacy to get it, take the private road. If one option becomes too onerous, the other is still available.
Private space can become oppressive if there is no public space to compete with it and vice versa.
I envision a world of many individual private spaces, linked by a framework of public spaces. The existence of such a framework may even be a prerequisite for complete control over one's own private space. Suppose a trespasser comes on my land and I want to push him off. But if there is a public walkway nearby, I have somewhere to push him. Thus, the availability of public space may be a moral precondition for the right to freedom from trespassers.