Creative AI poison pill developed - Page 1
Forum section: electronics / general

author: Bud
author_rank: Super Contributor
timestamp: November 02, 2023, 01:03:23 pm
content: A tool called Nightshade is screwing up AI image scraping/training by manipulating image pixels. Google for "Nightshade AI poison". The goal is to protect artists's intellectual property.

author: tom66
author_rank: Super Contributor
timestamp: November 02, 2023, 02:14:20 pm
content: If you can't beat it, er... smash your toys on the floor and have a tantrum? If AI generation can replicate art to the level at which a professional does it, is that not more evidence that the skill is likely to die away much like horse farriers became substantially less employable with the invention of the car?Of course I say this as someone whose day job does involve at least some amount of software development, so maybe I won't be so happy when AI tools can actually write competent code. I can see the dilemma artists face, but the "make it not possible" crowd is never going to win. The cat is out of the bag; I can runStable Diffusionon a £300 graphics card, it is not going away.If this poison pill method involves hiding details in e.g. the least significant bits of the image, or adding extra metadata, it'll just require manual human tagging and/or filtering to be applied to the input data set. That will only take a bit more time. A great deal of input images in these models are already manually tagged, because the tag sets that come with the images aren't good enough yet.

author: ebastler
author_rank: Super Contributor
timestamp: November 02, 2023, 02:40:00 pm
content: Quote from: Bud on November 02, 2023, 01:03:23 pmPaper is here:https://arxiv.org/pdf/2310.13828.pdfHaving glanced through it, I am not sure I have understood the concept yet. It isnotthe simple "dirty label" approach, where you feed the AI images with misleading meta-information during the training process. (They talk about that as a reference point in section 4.)Rather, they create images which look "right" to a human observer, but contain another, misleading image mixed in at a small amplitude (section 5). Is it just a linear combination of two images, and will the AI still pick up (misleading) patterns from the low bits?

author: Bud
author_rank: Super Contributor
timestamp: November 02, 2023, 02:40:31 pm
content: The original MIT Technology Review article gives actual samples of image transformations caused by poisoning. The article is called "This new data poisoning tool lets artists fight back against generative AI"

author: ebastler
author_rank: Super Contributor
timestamp: November 02, 2023, 02:44:32 pm
content: Quote from: Bud on November 02, 2023, 02:40:31 pmYes, I saw those. Those are examples of theresults, generated by AI models which have been "poisoned". (They are actually taken from the paper I linked to.) But how does the process of "poisoning" work??

author: AndyBeez
author_rank: Frequent Contributor
timestamp: November 02, 2023, 03:01:56 pm
content: I think they have accidentally invented generative avant-garde art. GAGA

author: Bud
author_rank: Super Contributor
timestamp: November 02, 2023, 03:05:41 pm
content: Some funny examples are given in the same articleQuote

author: pickle9000
author_rank: Super Contributor
timestamp: November 02, 2023, 04:42:04 pm
content: And so two new industries are born, one for one against.

author: mendip_discovery
author_rank: Super Contributor
timestamp: November 04, 2023, 01:07:15 pm
content: It is called Glaze,https://glaze.cs.uchicago.edu/I can see why some artists want to be protective of their images online. They put them there for education/promotion but not for them to be used by an AI program that can then generate images based on that artwork with just a few minor changes to make it different enough to avoid copyright issues. It is quite interesting that we live in a time where lawyers if shown enough money will go after anyone over patent or copyright claims but then there are sections of the internet where this is flagrantly ignored, its why I gave up doing motorsports photography as no one bought images, just just took photos with their phones and shared them on social media.