Control over the bridges across the Harlem River plagued the period of British colonial rule