Only modify exactly that port bit...