There was a large house painted in many gay colours standing close to the castle and the canal upon which latter were to be seen many ships laden with apples and pottery

Can you repeat this sentence, but add in punctuation?
There was a large house painted in many gay colours standing close to the castle and the canal, upon which latter were to be seen many ships laden with apples and pottery.