We do indeed, LdapUtils#closeConnection():

https://github.com/Jasig/cas/blob/master/cas-server-support-ldap/src/main/java/org/jasig/cas/util/LdapUtils.java

Thanks for the suggestion, will fix.