Yes, filling the holes is a good idea to prevent your dog from returning to the same spots. Use the same type of soil to match the surroundings.