If the halloumi is sliced too thin, you run the risk of it breaking apart as you slice it and getting very uneven pieces to grill. Place all the halloumi slices into a dish in a single layer and drizzle with a light coating of olive oil. Season with pepper and a light dusting of salt.