Adds support for Floating IP

Move the cleanup to a finally block or an `afterClass` that always runs.