Lafayette County was created on December 23 , 1856 from part of Madison County .
Lafayette County was created December 23 , 1856 from part of Madison County , and included at the time what is now both Lafayette and Dixie Counties .