Freelon was born in Philadelphia, Pennsylvania on March 26, 1952, to Allan R. Freelon, Jr. and Elizabeth N. Freelon. His grandfather was Allan R. Freelon, Sr., an impressionist painter during the Harlem Renaissance. In 1975, he graduated from North Carolina State University’s College of Design and earned a master’s degree in architecture at the Massachusetts Institute of Technology (MIT).