Unlike a savings account which you can open at practically any bank or credit union, U.S government bonds can only be electronically bought and redeemed via the U.S Treasury website.