Yes, you can give a gift that is not on the registry. Just make sure that it is relevant to the couple's interests and personality.