Fix swiftbox event handlers getting added too many times