After 3 hours, the ants have removed 4 * 3 = <<4*3=12>>12 ounces of sugar.
There are 24 - 12 = <<24-12=12>>12 ounces of sugar left.
Thus, the ants need 12 / 4 = <<12/4=3>>3 more hours to harvest the remaining sugar.
#### 3