The New York Landmarks Preservation Committee voted unanimously against giving protected status to a building constructed in the 1850s , that developers want to tear down to build an Islamic community center and mosque .