Some people are relaxing in front of a large red building.
Lots of people are walking by a small red building.
The red building must be either large or small.
if people are relaxing then they are most likely sitting or laying not walking
People who are walking in front of a red building aren't relaxing and a building can't be both small and big