Release buffer before putting server conn to pool.

This can save memory if the server conn is not going to be used soon.