You’re right to be cautious. Over time, dense vines can loosen or dislodge structures not meant to bear weight. Consider attaching a light trellis to the post instead, allowing the clematis to gracefully twine without causing any pulling.
The airy blooms of the clematis will enhance your mailbox without compromising its stability.