It depends on how you decline the offer. If you’re professional, there should be no burned bridges.