Remove unused refaddr and attributes

Some leftovers?

Regards,
Henk van Oers

PS: I want to make a FreeBSD port for this module.
Can you also push this change to CPAN?

Tnx.