In the first four houses, there are a total of 4 houses * 3 gnomes = <<4*3=12>>12 gnomes.
Therefore, the fifth house had 20 total gnomes – 12 gnomes = <<20-12=8>>8 gnomes.
#### 8