According to State Department regulations (e-CFR §62.31), only designated sponsor agencies are able to sponsor an Au Pair visa. There are sixteen designated Au Pair agencies in the U.S. To bring an Au Pair into the U.S. on the J-1 Visa, you would have to work with one of those sixteen agencies. So in this sense, no, you cannot find an Au Pair without an agency.