This typically happens because there is nothing to draw guests away from the table. To discourage hanging about the table, place chairs and smaller standing tables away from the buffet table, then have a kind host or helper to guide people toward these areas for eating. It can also help to have a helper or the host kindly ask people to move along once they've served themselves.