Cut potatoes lengthwise into eighths and lay in center of the foil.
Drizzle potatoes with olive oil. In a small bowl, combine thyme, oregano, rosemary, garlic powder, and paprika. Sprinkle over potatoes and toss gently to coat evenly. Wrap and seal foil securely with tight double folds. Place on grill about 4 to 6 inches from source of heat over medium-hot coals.