The Howe brothers then paused to consolidate their position, and the admiral engaged in a fruitless peace conference with Congressional representatives on September 11. Four days later the British landed on Manhattan, a bombardment from the river scattering inexperienced militia into a panicked retreat, and forcing Washington to retreat further. After Washington stopped the British advance up Manhattan at Harlem Heights on September 16, Howe again made a flanking maneuver, landing troops at Pell's Point in a bid to cut off Washington's avenue of retreat. To defend against this move, Washington withdrew most of his army to White Plains, where after a short battle on October 28 he retreated further north. This isolated the remaining Continental Army troops in upper Manhattan, so Howe returned to Manhattan and captured Fort Washington in mid November, taking almost 3,000 prisoners. Four days later, Fort Lee, across the Hudson River from Fort Washington, was also taken. Washington brought much of his army across the Hudson into New Jersey, but was immediately forced to retreat by the aggressive British advance.