Although he noted potential conflicts of interest, and the need for a "municipal legislature for local purposes," Madison did not address the district's role in national voting