 Brown was born in West Palm Beach, Florida to trucking company owner James and mother Sherry Brown. He attended Palm Beach Lakes High School where he played football and basketball. Brown received a letter in basketball all four years. Over the course of his high school football career, Brown compiled more than 7,100 passing yards and 73 touchdowns. As a senior, he recorded 1,800 passing yards for 18 touchdowns, and 485 rushing yards. The Sun-Sentinel named him the player of the year and he was also named the all-state quarterback at the 6-A level. Rivals.com rated him a three-star prospect and the 12th-ranked dual-threat quarterback in the 2005 recruiting class. Brown received scholarship offers from Central Florida, Iowa, Minnesota, NC State, and West Virginia.
