If you only have an easement to access the driveway, that is nothing more than the ability to use or drive over, etc. the driveway; it is not ownership of it. Not owning it, you have no right to stop anyone else whom the property owner (the surrounding homeowner) lawfully allows to use it.