Use a deque for the fingerprints

A set is probably more technically appropriate, but I don't want it to
grow indefinitely.