The Howe brothers then paused to consolidate their position, and the admiral engaged in a fruitless peace conference with Congressional representatives on September 11. Four days later the British landed on Manhattan, scattering inexperienced militia into a panicked retreat, and forcing Washington to retreat further. After Washington stopped the British advance up Manhattan at Harlem Heights on September 16, Howe again made a flanking maneuver, landing troops at Pell's Point in a bid to cut off Washington's avenue of retreat. To defend against this move, Washington withdrew most of his army to White Plains, where after a short battle on October 28 he retreated further north. This isolated the remaining Continental Army troops in upper Manhattan, so Howe returned to Manhattan and captured Fort Washington in mid November, taking almost 3,000 prisoners. Four days later, Fort Lee, across the Hudson River from Fort Washington, was also taken. Washington brought much of his army across the Hudson into New Jersey, but was immediately forced to retreat by the aggressive British advance. During the campaign a general lack of organization, shortages of supplies, fatigue, sickness, and above all, lack of confidence in the American leadership resulted in a melting away of untrained regulars and frightened militia. Washington grumbled, "The honor of making a brave defense does not seem to be sufficient stimulus, when the success is very doubtful, and the falling into the Enemy's hands probable."