Benjamin Butler ( politician ) Benjamin Franklin Butler ( November 5 , 1818 – January 11 , 1893 ) was an American lawyer and politician who represented Massachusetts in the United States House of Representatives and later served as the 33rd Governor of Massachusetts . In 1868 , as a member of the U . S . House of Representatives , Butler had a prominent role in the impeachment of President Andrew Johnson . As Chairman of the House Committee on Reconstruction , Butler authored the Ku Klux Klan Act of 1871 , signed into law by President Ulysses S . Grant , that gave federal authority to prosecute and destroy the Klan in the South . Butler authored , along with Sen . Charles Sumner , the Civil Rights Act of 1875 , signed into law by President Grant . This law , a final act of Reconstruction , gave African American US citizens the right to public accommodation such as hotels , restaurants , lodging , and public entertainment establishments . During the American Civil War , he served as a major general in the Union Army . His policies regarding slaves as contraband so they could be treated as free men , his administration of occupied New Orleans , his ineffectual leadership in the Bermuda Hundred Campaign , and the fiasco of Fort Fisher rank him as one of the most controversial political general s of the war . Butler was the first Eastern Union General to declare runaway Virginia slaves " contraband of war " ; refusing to return them to their masters . He was widely reviled for years after the war by Southern whites , who gave him the nickname " Beast Butler . " Although considered a hostile Union Army general while commanding New Orleans , Butler , through his Christian charity , made efforts to care for the poor and needy , giving $ 1 , 000 of his personal money to purchase food for those who were starving . As all business activity was shut down , Butler gave railroad and steam loading permits to operators , relieving the city of starvation . Butler received permission from the city to employ the poor to clean up the streets and under the supervision of Col . T . B . Thorpe , a million dollars of land was added to the state from the Mississippi River deposits . At the request of Lieutenant General Ulysses S . Grant , Butler was relieved of duty on January 8 , 1865 having failed to capture Fort Fisher . Early life . Benjamin Franklin Butler was born in Deerfield , New Hampshire , the sixth and youngest child of John Butler and Charlotte Ellison Butler . His father served under General Andrew Jackson at the Battle of New Orleans during the War of 1812 and later became a privateer , dying of yellow fever in the West Indies not long after Benjamin was born . He was named after Founding Father Benjamin Franklin . His elder brother , Andrew Jackson Butler ( 1815 – 1864 ) , would serve as a colonel in the Union Army during the Civil War and joined him in New Orleans . Butler ' s mother was a devout Baptist who encouraged him to read the Bible and prepare for the ministry . In 1827 , at the age of nine , Butler was awarded a scholarship to Phillips Exeter Academy , where he spent one term . He was described by a schoolmate as " a reckless , impetuous , headstrong , boy " , and regularly got into fights . Butler ' s mother moved the family in 1828 to Lowell , Massachusetts , where she operated a boarding house for workers at the textile mills . He attended the public schools there , from which he was almost expelled for fighting , the principal describing him as a boy who " might be led , but could not be driven . " He attended Waterville ( now Colby ) College in pursuit of his mother ' s wish that he prepare for the ministry , but eventually rebelled against the idea . In 1836 he sought permission to go instead to West Point for a military education , but did not receive one of the few places available . He continued his studies at Waterville , where he sharpened his rhetorical skills in theological discussions , and began to adopt Democratic political views . He graduated in August 1838 . Butler returned to Lowell , where he clerked and studied law with a local lawyer . He was admitted to the Massachusetts bar in 1840 , and opened a practice in Lowell . He quickly gained a reputation as a dogged criminal defense lawyer who seized on every misstep of his opposition to gain victories for his clients , and also became a specialist in bankruptcy law . His trial work was so successful that it received regular press coverage , and he was able to expand his practice into Boston . After an extended courtship , he married Sarah Hildreth , a stage actress and daughter of Dr . Israel Hildreth of Lowell , on May 16 , 1844 . They had four children : Paul ( 1845 – 1850 ) , Blanche ( 1847 - 1939 ) , Paul ( 1852 - 1918 ) and Ben - Israel ( 1855 - 1881 ) . His business partners included Sarah ' s brother Fisher , and her brother - in - law W . P . Webster . Entry into politics . Butler ' s success as a lawyer enabled him to purchase shares in Lowell ' s Middlesex Mill Company when they were cheap . Although he generally represented workers in legal actions , he also sometimes represented mill owners . This adoption of both sides of an issue manifested when he became more politically active . He first attracted general attention by advocating the passage of a law establishing a ten - hour day for laborers , but he also opposed labor strike s over the matter . He instituted the ten - hour day at the Middlesex Mills . During the debates over the ten - hour day a Whig - supporting Lowell newspaper published a verse suggesting that Butler ' s father had been hanged for piracy . Butler sued the paper ' s editor and publisher for that and other allegations that had been printed about himself . The editor was convicted and fined $ 50 , but the publisher was acquitted on a technicality . Butler blamed the Whig judge , Ebenezer Rockwood Hoar , for the acquittal , inaugurating a feud between the two that would last for decades and significantly color Butler ' s reputation in the state . Butler , as a Democrat , supported the Compromise of 1850 and regularly spoke out against abolition . However , at the state level , he supported the coalition of Democrats and Free Soilers that elected George S . Boutwell governor in 1851 . This garnered him enough support to win election to the state legislature in 1852 . His support for Franklin Pierce as president , however , cost him the seat the next year . He was elected a delegated to the 1853 state constitutional convention with strong Catholic support , and was elected to the state senate in 1858 ( a year dominated by Republican victories in the state ) . Butler was nominated for governor in 1859 and ran on a pro - slavery , pro - tariff platform ; he narrowly lost to incumbent Republican Nathaniel Prentice Banks . In the 1860 Democratic National Convention at Charleston , South Carolina , Butler initially supported John C . Breckenridge , but then shifted his support to Jefferson Davis , believing that only a moderate Southerner could keep the Democratic party from dividing . A conversation he had with Davis prior to the convention convinced him that Davis might be such a man , and he gave him his support before the convention split . Butler ended up supporting Breckenridge over Douglas against state party instructions , ruining his standing with the state party apparatus . He was nominated for governor in the 1860 election by a Breckenridge splinter of the state party , but trailed far behind other candidates . Civil War . Although he sympathized with the South , Butler stated that " I was always a friend of southern rights but an enemy of southern wrongs " , and sought to serve in the Union army . His military career prior to the Civil War began as a private in the Lowell militia in 1840 . Butler eventually rose to become colonel of a regiment of primarily Irish American men . In 1855 , the nativist Know Nothing Governor Henry J . Gardner disbanded Butler ' s militia , but Butler was elected brigadier general after the militia was reorganized . In 1857 Secretary of War Jefferson Davis appointed him to the Board of Visitors of West Point . These positions did not give him any significant military experience . After Abraham Lincoln was elected president in November 1860 , Butler traveled to Washington , D . C . When a secessionist South Carolina delegation arrived there , he recommended to lame duck President James Buchanan that they be arrested and charged with treason . Buchanan refused the idea . Butler also met with Jefferson Davis , and learned that he was not the Union man that Butler had previous thought he was . Butler then returned to Massachusetts , where he warned Governor John A . Andrew that hostilities were likely , and that the state militia should be readied . He took advantage of this mobilization to secure a contract with the state for his mill to supply heavy cloth to the militia . Military contracts would constitute a significant source of profits for Butler ' s mill throughout the war . Butler also worked to secure a leadership position should the militia be deployed . He first offered his services to Governor Andrew in March 1861 . When the call for militia finally arrived in April , Massachusetts was asked for only three regiments , but Butler managed to parlay this to include a request for a brigadier . He telegraphed Secretary of War Simon Cameron , with whom he was acquainted , suggesting that Cameron issue a request for a brigadier and general staff from Massachusetts , which soon afterward appeared on Governor Andrew ' s desk . He then used banking contacts to ensure that loans that would be needed to fund the militia operations would be conditioned on his appointment . Despite Andrew ' s desire to assign the brigadier position to Ebenezer Peirce , the bank insisted on Butler , and he was sent south to ensure the security of transportation routes to Washington . The nation ' s capital was threatened with isolation from non - slave states because it was unclear whether Maryland , a slave state , would also secede . Baltimore and Virginia operations . The two regiments Massachusetts sent to Maryland were the 6th and 8th Volunteer Militia . The 6th departed first , and was caught up in a secessionist riot in Baltimore , Maryland on April 19 . Butler traveled with the 8th , which left Philadelphia the next day amid news that railroad connections around Baltimore were being severed . Butler and the 8th traveled by rail and ferry to Maryland ' s capital , Annapolis , where Governor Thomas H . Hicks attempted to dissuade them from landing . Butler landed his troops ( which needed food and water ) , occupying the Naval Academy . When Governor Hicks informed Butler that no one would sell provisions to his force , Butler pointed out that armed men did not necessarily have pay for needed provisions , and that he would use all measures necessary to ensure order . After being joined by the 7th New York Militia , Butler directed his men to restore rail service between Annapolis and Washington via Annapolis Junction , which was accomplished by April 27 . He also threatened Maryland legislators with arrest if they voted in favor of secession , and eventually seized the Great Seal of Maryland . Butler ' s prompt actions in securing Annapolis were received with approval by the US Army ' s top general , Winfield Scott , and he was given formal orders to maintain the security of the transit links in Maryland . In early May , Scott ordered Butler to lead the operations that occupied Baltimore . On May 13 he entered Baltimore on a train with 1 , 000 men and artillery against no opposition . This was done in contravention to Butler ' s orders from Scott , which had been to organize four columns to approach the city by land and sea . General Scott criticized Butler for his strategy ( despite its success ) , as well as his heavy - handed assumption of control of much of the civil government , and recalled him to Washington . Butler shortly after received one of the early appointments as major general of the volunteer forces . His exploits in Maryland also brought nationwide press attention , including significant negative press in the South , which concocted stories about him that were conflations of biographical details involving not just Butler , but also a namesake from New York and others . When the two regiments Massachusetts had been sent overland to Maryland , two more were dispatched by sea under Butler ' s command to secure Fort Monroe at the mouth of the James River . After being dressed down by Scott for overstepping his authority , Butler was next assigned command of Fort Monroe and of the Department of Virginia . On May 27 , Major General Butler sent a force north to occupy the lightly defended adjacent town of Newport News , Virginia at Newport News Point , an excellent anchorage for the Union Navy . This force established and significantly fortified Camp Butler and a battery at Newport News Point that could cover the entrance to the James River ship canal and the mouth of the Nansemond River . By May 29 , Butler ' s force , which included the 1st Vermont Infantry , Colonel John A . Bendix ' s 7th New York Volunteer Infantry Regiment ( a regiment of German speakers ) , the 4th Massachusetts Volunteer Infantry Regiment , Scott ' s Life Guards , and a detachment of U . S . Regulars to man artillery , completed the mission . On June 8 , the camp , which was commanded by Colonel Phelps of the 1st Vermont Infantry , was reinforced by the 9th New York Volunteer Infantry Regiment ( Hawkin ' s Zouaves ) . Butler also further occupied and expanded Camp Hamilton , started by Colonel Dimick in the equally lightly defended , adjacent town of Hampton , Virginia , just beyond the confines of the fort and within the range of its guns . The Union occupation of Fort Monroe was considered a potential threat on Richmond by Confederate General Robert E . Lee , and he began organizing the defense of the Virginia Peninsula in response . Confederate General John B . Magruder , seeking to buy time while awaiting men and supplies , established well - defended forward outposts near Big and Little Bethel , only from Butler ' s camp at Newport News as a lure to draw his opponent into a premature action . Butler took the bait , and suffered an embarrassing defeat in the Battle of Big Bethel on June 10 . Butler devised a plan for a night march and operation against the positions , but chose not to lead the force in person , for which he was later criticized . The plan proved too complex for his untrained and undertrained subordinates and troops to carry out , especially at night , and was further marred by the failure of staff to communicate all passwords and precautions . A friendly fire incident during the night gave away the Union position and they were further harmed by advancing without knowledge of the layout or strength of the Confederate positions . The commander in the field , Massachusetts militia general Ebenezer Peirce , received the most criticism for the failed operation . With the withdrawal of many of his men for use elsewhere , Butler was unable to maintain the camp at Hampton although his forces did retain the camp at Newport News . While in command at Fort Monroe , Butler declined to return to their owners fugitive slave s who had come within his lines . He argued that Virginians considered them to be chattel property , and that they could not appeal to the Fugitive Slave Law of 1850 since they claimed independence . Furthermore , slaves used as laborers for building fortifications and other military activities could be considered contraband of war . The U . S . Congress later mandated that other Union commanders refuse to return slaves to their former masters , using similar arguments . Butler promptly received official approval for his decision from President Lincoln . New Orleans . Later in 1861 , Butler commanded an expeditionary force that , in conjunction with the United States Navy , took Forts Hatteras and Clark in North Carolina . He directed the first Union expedition to Ship Island , off the Mississippi Gulf Coast , in December 1861 . In May 1862 , he commanded the force that conducted the capture of New Orleans after its occupation by the Navy after the Battle of Forts Jackson and St . Philip . In the administration of that city he showed great firmness and political subtlety . He devised a plan for poor relief , demanded oaths of allegiance from anyone who sought any privilege from government , and confiscated weapons . In an ordinary year , it was not unusual for as much as 10 % of the city ' s population to die of yellow fever . In preparation , Butler imposed strict quarantines and introduced a rigid program of garbage disposal . As a result , in 1862 , only two cases were reported . Many of his acts , however , were unpopular . Most notorious was Butler ' s General Order No . 28 of May 15 , 1862 , that if any woman should insult or show contempt for any officer or soldier of the United States , she shall be regarded and shall be held liable to be treated as a " woman of the town plying her avocation " , i . e . , a prostitute . This was in response to women in the town who were pouring buckets of their own urine on Union soldiers , and who at the time could get away with anything as respectable women . Butler ' s order had no sexual connotation ; rather , it permitted soldiers not to treat women performing such acts as ladies . If a woman punched a soldier , he could punch her back . The order stopped all of their behavior , without arresting anyone or firing a bullet , but provoked protests both in the North and the South , and also abroad , particularly in England and France . He was nicknamed " ' Beast ' Butler " or alternatively " ' Spoons ' Butler , " the latter nickname derived from an incident in which a woman was arrested for smuggling and the silverware she was carrying was confiscated . While no proof exists that Butler was corrupt it is possible that he knew of the illegal activities of his brother Andrew , also in the army in New Orleans . However , upon arriving in the city Butler immediately began attempts to participate in the lucrative inter - belligerent trade . He used a Federal warship send $ 60 , 000 in sugar to Boston where he expected to sell it for $ 160 , 000 . However , his use of the government ship was reported . Instead of earning a profit , military authorities permitted him to recover only his $ 60 , 000 plus expenses . Thereafter , his brother Andrew officially represented the family in such activities . Everyone in New Orleans believed that Andrew accumulated a profit of $ 1 – $ 2 million while in Louisiana . Upon inquiry from Treasury Secretary Chase in October 1862 , the General responded that his brother actually cleared less than $ 200 , 000 . Shortly after the Second Confiscation Act became effective in September 1862 General Butler increasingly relied upon it as a means of grabbing cotton . Since the Act permitted confiscation of property owned by anyone aiding the Confederacy , Butler reversed his earlier policy of encouraging trade by refusing to confiscate cotton brought into New Orleans for sale . First he conducted a census in which 4 , 000 respondents failing to pledge loyalty to the Union were banished and their property seized . It was sold at ridiculously low auction prices where Andrew was often the prime buyer . Next the general sent expeditions into the countryside with no military purpose other than to confiscate cotton from residents assumed to be disloyal . Once brought into New Orleans the cotton would be similarly sold in rigged auctions . To maintain correct appearances , auction proceeds were dutifully held for the benefit of " just claimants " , but the Butler consortium still ended - up owning the cotton at bargain prices . Always inventive of new terminology to achieve his ends , Butler sequestered ( i . e . made vulnerable to confiscation ) such " properties " in all of Louisiana beyond parishes surrounding New Orleans . At his death , Butler ' s net worth was about $ 7 million . " The source of his fortune is a mystery , but much of it came from New Orleans . . . " Butler censored New Orleans newspapers . When editor of the " Commercial Bulletin " William Seymour asked Butler what would happen if the newspaper ignored his censorship , an angry Butler reportedly stated , " I am the military governor of this state — the supreme power — you cannot disregard my order , Sir . By God , he that sins against me , sins against the Holy Ghost . " When Seymour published a favorable obituary of his father , who had been killed serving in the Confederate army in Virginia , Butler confiscated the newspaper and imprisoned Seymour for three months . He also closed " The Picayune " when it ran an editorial that he found offensive . Historian John D . Winters wrote that most of the newspapers " were allowed to reopen later but were so rigidly controlled that all color and interest were drained away " and that churches that planned a special day of prayer and fasting for the Confederacy were forbidden from doing so . Several clergymen were placed under arrest for refusing to pray for President Lincoln . The Episcopal churches were closed , and their three ministers were sent to New York City under military escort . On June 7 Butler executed William B . Mumford , who had torn down a United States flag placed by Admiral Farragut on the United States Mint in New Orleans . Most , including Mumford and his family , expected Butler to pardon him ; the general refused , but promised to care for his family if necessary . ( After the war Butler fulfilled his promise , paying off a mortgage on Mumford ' s widow ' s house and helping her find government employment . ) For the execution and General Order No . 28 he was denounced ( December 1862 ) by Confederate President Jefferson Davis in General Order 111 as a felon deserving capital punishment , who if captured should be reserved for execution . Butler also took aim at foreign consuls in New Orleans . He ordered the seizure of $ 800 , 000 that had been deposited in the office of the Dutch consul , imprisoned the French Champagne magnate Charles Heidsieck , and took particular aim at George Coppell of Great Britain , whom he suspended for refusal to cooperate with the Union . Instead , Butler accused Coppell of giving aid to the Confederate cause . U . S . Secretary of State William Henry Seward sent Reverdy Johnson to New Orleans to investigate complaints of foreign consuls against certain Butler policies . Even when told by President Lincoln to restore a sugar shipment claimed by Europeans , Butler undermined the order . He also imposed a strict quarantine to protect against yellow fever , which had the added impact of delaying foreign commerce and bringing complaints to his headquarters from most foreign consuls . With the Federal occupation , runaway slaves and slaves from abandoned plantations arrived in large numbers in New Orleans . These unattached persons had to be fed and housed . A Union officer complained of " a big problem " with the new arrivals . John D . Winters wrote that " Soldiers resented the fact that the pampered Negro was given better tents , equal rations , and was allowed to tear down more fences for sleeping boards than were the soldiers . General Phelps [ an abolitionist ] had organized a few squads of Negroes and drilled them daily . . . . Not knowing what to do with so many Negroes , Butler at first returned the runaway slaves to their masters . But still the contrabands came . Some of them were employed as cooks , nurses , washwomen , and laborers . . . . [ Finally ] Butler ordered . . . the exclusion of all unemployed Negroes and whites from his lines . " Although Butler ' s governance of New Orleans was popular in the North ( where it was seen as a successful stand against recalcitrant secessionists ) , some of his actions , notably those against the foreign consuls , concerned President Lincoln , who authorized his recall in December 1862 . Butler was replaced by Nathaniel Banks . The necessity of taking sometimes radical actions , and the support he received in Radical Republican circles drove Butler to change political allegiance . He also sought revenge against the more moderate Secretary of State Seward , who he believed to be responsible for his recall . Army of the James . Butler ' s popularity with the radicals meant that Lincoln could not readily deny him a new posting . Lincoln considered sending him to position in the Mississippi River area in early 1863 , and categorically refused to send him back to New Orleans . He finally gave Butler command of the Department of Virginia and North Carolina in November 1863 . In January 1864 Butler played a pivotal role in the creation of six regiments of U . S . Volunteers recruited from among Confederate prisoners of war ( " Galvanized Yankees " ) for duty on the western frontier . In May , the forces under his command were designated the Army of the James . General Ulysses S . Grant , who did not think highly of Butler ' s military skills , ordered him to attack in the direction of Petersburg from the east , destroying the rail links supplying Richmond and distracting Robert E . Lee , in conjunction with attacks Grant would make from the north . Rather than striking immediately at Petersburg as ordered , Butler ' s offensive bogged down east of Richmond in the area called the Bermuda Hundred , immobilized by the greatly inferior force of Confederate General P . G . T . Beauregard , and he was unable to accomplish any of his assigned objectives . But it was his mismanagement of the expedition against Fort Fisher , North Carolina , that finally led to his recall by General Grant . Fort Fisher and Butler ' s recall . Butler ' s status as a key political ally of President Abraham Lincoln prevented General Grant from removing him from military service prior to the presidential election of November 1864 . As a prominent Radical Republican , Butler was also under consideration as a possible opponent of Lincoln in that year ' s election , and Lincoln had asked Butler to serve as his Vice President in early 1864 . After the election , however , Grant wrote to Secretary of War Edwin M . Stanton in early 1865 asking free rein to relieve Butler from military service . Since Stanton was traveling outside Washington , D . C . , at the time , Grant appealed directly to Lincoln for permission to terminate Butler , noting " there is a lack of confidence felt in [ Butler ' s ] military ability " . In General Order Number 1 , Lincoln relieved Butler from command of the Department of North Carolina and Virginia and ordered him to report to Lowell , Massachusetts . Grant informed Butler of his recall on January 8 , 1865 , and named Major General Edward O . C . Ord to replace him as commander of the Army of the James . Rather than report to Lowell , Butler went to Washington , where he used his considerable political connections to get a hearing before the Joint Congressional Committee on the Conduct of the War in mid - January . At his hearing Butler focused his defense on his actions at Fort Fisher . He produced charts and duplicates of reports by subordinates to prove he had been right to call off his attack of Fort Fisher , despite orders from General Grant to the contrary . Butler claimed the fort was impregnable . To his embarrassment , a follow - up expedition led by Maj . Gen . Alfred H . Terry captured the fort on January 15 , and news of this victory arrived during the committee hearing ; Butler ' s military career was over . He was formally retained until November 1865 with the idea that he might act as military prosecutor of Confederate President Jefferson Davis . Postbellum political career . At the urging of his wife , Butler actively sought another political position in the Lincoln administration , but this came to an end with Lincoln ' s assassination in April 1865 . Butler instead turned his eyes to Congress , and was elected in 1866 on a platform of civil rights and opposition to President Andrew Johnson ' s weak Reconstruction policies . He supported a variety of populist or social reform positions , including women ' s suffrage , an eight - hour workday for federal employees , and the issuance of greenback currency . He served four terms ( 1867 – 75 ) before losing reelection , and was then once again elected in 1876 for a single term . In 1868 Butler was selected to be one of the managers of the impeachment of President Johnson before the Senate . Although Thaddeus Stevens was the principal guiding force behind the impeachment effort , he was aging and ill at the time , and Butler stepped in to become the main organizing force in the prosecution . The case was focused primarily on Johnson ' s removal of Secretary of War Edwin Stanton in violation of the Tenure of Office Act , and was weak because the constitutionality of the law had not been decided . The trial was a somewhat uncomfortable affair , in part because the weather was hot and humid , and the chamber was packed . The prosecution ' s case was a humdrum recitation of facts already widely known , and it was attacked by the defense ' s William Evarts , who drowned the proceedings by repeatedly objecting to Butler ' s questions , often necessitating a vote by the Senate on whether or not to allow the question . Johnson ' s defense focused on the point that his removal of Stanton fell within the bounds of the Tenure of Office Act . Despite some missteps by the defense , and Butler ' s vigorous cross - examination of defense witnesses , the impeachment failed by a single vote . In the interval between the trial and the Senate vote , Butler searched without success for substantive evidence that Johnson operatives were working to bribe undecided Senators . After acquittal on the first article voted on , Senate Republicans voted to adjourn for ten days , seeking time to possibly change the outcome on the remaining articles . During this time , Butler established a House committee to investigate the possibility that four of the seven Republican Senators who voted for acquittal had been improperly influenced in their votes . He uncovered some evidence that promises of patronage had been made and that money may have changed hands but was unable to decisively link these actions to any specific Senator . Butler wrote the initial version of the Civil Rights Act of 1871 ( also known as the Ku Klux Klan Act ) . After his bill was defeated , Representative Samuel Shellabarger of Ohio drafted another bill , only slightly less sweeping than Butler ' s that successfully passed both houses and became law upon Grant ' s signature on April 20 . Along with Republican Senator Charles Sumner , Butler proposed the Civil Rights Act of 1875 , a seminal and far - reaching law banning racial discrimination in public accommodations . The Supreme Court of the United States declared the law unconstitutional in the Civil Rights Cases ( 1883 ) . Racial minorities in the United States would have to wait nearly a century before the Civil Rights Act of 1964 would reenact and expand the provisions of the law Butler backed . He exercised a marked influence over President Grant and was regarded as his spokesman in the House . He was one of the foremost advocates of the payment in greenbacks of the government bonds . During his time in the House , he served as chairman of the US House Committee on Revision of the Laws in the 42nd Congress and the Judiciary Committee in the 43rd Congress . Butler was a wealthy industrialist who founded the United States Cartridge Company of Lowell , Massachusetts . In 1872 , Butler was one of several high - profile investors who were deceived by Philip Arnold in a famous diamond and gemstone hoax . Butler ran unsuccessfully for Governor of Massachusetts as an independent in 1878 , and also , in 1879 , when he ran on the Democratic and Greenback tickets , but , in 1882 , he was elected by the Democrats , who won no other state offices . From 1883 to 1884 , he was Governor of Massachusetts . As governor , he appointed the first Irish - American judge , and the first African - American judge — George Lewis Ruffin . He also appointed the first woman to executive office , Clara Barton , to head the Massachusetts Reformatory for Women . As presidential nominee of the Greenback and Anti - Monopoly parties , he polled 175 , 370 votes in the presidential election of 1884 . He had bitterly opposed the nomination by the Democratic party of Grover Cleveland and tried to defeat him by throwing his own votes in Massachusetts and New York to the Republican candidate , James G . Blaine . Butler ' s income as a lawyer was estimated at $ 100 , 000 per year shortly before his death . He was an able but erratic administrator , and a brilliant lawyer . As a politician , he excited bitter opposition , and was charged , apparently with justice , with corruption and venality in conniving at , and sharing , the profits of illicit trade with the Confederates carried on by his brother at New Orleans and by his brother - in - law in the Department of Virginia and North Carolina , while General Butler was in command . Butler died while attending court in Washington , D . C . . He is buried in his wife ' s family cemetery , behind the main Hildreth Cemetery in Lowell . His daughter Blanche married Adelbert Ames , a Mississippi governor and senator who had served as a general in the United States Army during the Civil War . Butler ' s descendants include the famous scientist Adelbert Ames , Jr . , suffragist and artist Blanche Ames Ames , Butler Ames , and George Plimpton . Legacy . The inscription on Butler ' s monument reads , " the true touchstone of civil liberty is not that all men are equal but that every man has the right to be the equal of every other man - if he can . " Butler is credited with beginning the tradition of the " lone walk " , the ceremonial exit from the office of Governor of Massachusetts , after finishing his term in 1884 . Since 2004 , a " Benjamin F . Butler Society " has met at the Hildreth family cemetery in early November to celebrate the birthday of General Butler , and to replace the American flag that flies over the cemetery . This is the only time of year the family plots , behind two locked gates and fenced off from the public cemetery , are open to the public .