Mercado dos Lavradores is the beginning of the Old Town quarter (even though you will not see signs for the Zona Velha until farther east).
The Old Town area starts at Mercado dos Lavradores.