Jones was born in Fairfield, Alabama, and is a graduate of the University of Alabama and Cumberland School of Law at Samford University. After law school, he worked as a congressional staffer and as a federal prosecutor before moving to private practice. In 1997, President Bill Clinton appointed Jones as U.S. Attorney for the Northern District of Alabama. Jones's most prominent cases were the successful prosecution of two Ku Klux Klan members for the 1963 Birmingham church bombing that killed four African-American girls and the indictment of domestic terrorist Eric Rudolph. He returned to private practice at the conclusion of Clinton's presidency in 2001.