If you want to take your rental car out of the country, you'll need to pay a small fee. Tell the staff that you want to cross the border, and they'll fill out a form. This will allow you to take your car into a new country temporarily and have it covered by insurance.