The simple answer is yes. You can use an overgrip without a replacement grip, but it isn’t always advisable you do. Using just an overgrip will make your racquet’s handle feel smaller, and that’s likely to affect control.