You can have keys that are not tomes. But you did bring up a valid point, I should delete the key regardless of it being a tome or not.