NOW it works with unloading. Just had to add udp_lib_unhash reference, which simply calls a generic sk release.