It is said that at the time of its construction , Shadows-on-the-Teche was only the third brick house to be built on Bayou Teche .
The house was said to be the third brick house built on Bayou Teche .