There are a few things you can do to thicken up your dressing. The first is to add in more peanut butter. This will help to thicken it up and also add more flavor. Another option is to add in some cornstarch or arrowroot powder. Simply whisk it into the dressing until it's combined and has reached the desired consistency.