Williams attended the Virginia Military Institute where he led the NCAA in scoring two straight seasons for the fast-paced VMI team. In April 2007, Williams initially decided to skip his senior season and enter the NBA Draft, but later elected to return to school for his senior season. On March 1, 2008, Williams became the state of Virginia's all-time Division I career scoring leader with 2,526 points. Williams graduated from VMI with a bachelor's degree in psychology.