build: Makefile should respect configure --prefix

ddf4d1a introduced a regression such that prefix's set with `configure` were ignored

cc @bnoordhuis