crypto: lower RSS usage for TLSCallbacks

see #8416