To thaw frozen kumquats, simply take out the amount you need and let them come to room temperature. If you're using them in a recipe, you can often add them directly to the dish without defrosting.