Yes yellow jackets can get through drywall, they will chew through drywall to create new holes and paths within their nest. they will chew through drywall to expand the size of their nests, they can chew through paper plasterboard wood and plastic.