Deepfake

{{sciencenav}}
{{cquote|In the future, entertainment will be randomly generated.|||Larry the Cucumber, ''VeggieTales'' ("The Wonderful World of Auto-Tainment!")<ref>(January 30, 2016). [https://www.youtube.com/watch?v=j4Ph02gzqmY "Veggietales predicts modern internet humour"]. ''VeggieTales'', clipped via YouTube.</ref>}}
'''Deepfakes''' (a term combining the machine learning technique "deep learning", and "fake") is essentially the creation of media using machine learning techniques. There is widespread concern that the use of deepfakes will make it a lot easier to spread disinformation, by allowing users to create fake media (including media that was much more difficult to alter in the past, such as videos) that would be much more difficult to discern from the legitimate product.<ref>https://www.cnn.com/interactive/2019/01/business/pentagons-race-against-deepfakes/</ref>

==Techniques==
Deepfakes can be seen as a subset of [[Machine_learning|machine learning]] computer techniques.

One way to make a "DeepFake" is to use a generative adversarial network, or GAN.<ref>https://medium.com/primalbase/why-the-danger-of-deepfakes-is-no-danger-at-all-82c21366e6c6</ref> GANs work by creating two neural networks. The first network, known as the generator, looks at training material fed into it (eg, photographs of the subject in question that you would want to fake) and attempts to produce artificial outputs by trying to mimic them. The second neural network (the discriminator) determines whether the output of the generator is "real". If the discriminator rejects the attempt, the generator tries again. Eventually, the generator learns the pattern well enough to fool the discriminator; thus, the algorithm is now trained and ready to generate the fake media.

This is just one example; other machine learning algorithms can also be applied to produce a deepfake.<ref>https://www.alanzucconi.com/2018/03/14/introduction-to-deepfakes/</ref> 

==Limitations==
There are limitations to any machine learning technology, and that includes deepfakes. The key is that machine learning algorithms typically need to be trained somehow, and this is not typically trivial. To produce a convincing video deepfake as of this writing (2019), you typically need a significant amount of computational power, a large set of photographs to train with (ideally within a narrow scope of parameters -- ideally the characteristics of the face of the person you are using to fake is pretty similar to what is in the image you doctor), and fairly good computer skills. <ref>https://www.technologyreview.com/s/612501/inside-the-world-of-ai-that-forges-beautiful-art-and-terrifying-deepfakes</ref> Deepfake applications typically require a significant amount of hand holding and data massaging in order to obtain reasonable quality. <ref>https://medium.com/primalbase/why-the-danger-of-deepfakes-is-no-danger-at-all-82c21366e6c6</ref> This [https://mrdeepfakes.com/forums/thread-guide-deepfacelab-explained-and-tutorials tutorial on one of several applications to assist in making a deepfake, DeepFaceLab], perhaps demonstrates the relative difficulty of the current process. 

On the other hand, the technology is currently mature enough where much of the complexity can be hidden from the user and processed on the backend, if developed properly. Recently, a Chinese mobile application called Zao made waves by creating an app that made creating a deepfake video a lot easier to do, allowing you to insert a face image (either from an uploaded file or a selfie) on short video clips. <ref>https://boingboing.net/2019/09/02/deepfake-face-swap-app-zao.html</ref> With Zao, there are limitations in the image you can use (the image you upload has to be a certain quality and characteristic, and at present the application tries to block any image it recognizes as being from a public figure), and the results are reportedly not perfect (occasionally somewhat jerky or occasionally odd). <ref>https://www.abacusnews.com/digital-life/we-tested-zao-viral-chinese-deepfake-app/article/3025497</ref> Still, it does show the potential power deepfakes may have for agents with enough backend computing power and professional development.

==Alternatives to deepfakes==
It is not necessary to go through the trouble of making a deepfake to spread disinformation. Many other techniques exist to spread fake media, including:

* [[Image_manipulation|Photoshop and other digital editing programs.]]
* Audio editors, using techniques such as time stretch and pitch shifting.<ref>https://www.washingtonpost.com/technology/2019/05/23/faked-pelosi-videos-slowed-make-her-appear-drunk-spread-across-social-media/#comments-wrapper</ref>
* Selective editing.<ref>https://www.vice.com/en_us/article/nedd9w/five-times-james-okeefe-embarrassed-himself-trying-to-out-liberal-bias</ref>
* Using look-alikes or sound-alike actors or actresses in staged productions.<ref>https://www.thedailybeast.com/inside-the-deepfake-arms-race</ref>
* [[Fake_news|Fake news]] [[clickbait]].
* [[Fake_news|Fake news]] websites.
* [[Fake_news|Fake news]] [[YouTube]] videos.

As many [[hoax]]ters have shown over the years, you don't need the most accurate media quality or plausibility to spread disinformation. So while there is much concern in media of lesser repute about this "shocking" technique that will "start plaguing your social media" with fakes and will be "accessible to everyday people within months",<ref>https://www.thesun.co.uk/tech/9984130/deepfakes-warning-videos-hao-li/</ref> the truth is the current technological barriers are at this moment rather high, too high for most disinformation agents to bother with, especially given the much easier alternatives. As a result, very few political, conspiratorial, or disinformation deepfakes exist currently. There certainly is good justification for raising concerns over privacy and disinformation and other ethical and moral issues to be applied as the technology improves, but the technology currently is too immature for major concern just yet, with one major exception.

==Current applications of deepfake technology==
===Pornography===
Being a fiddly, time-consuming technology, deepfake applications are of limited use for most people, for now. However, they have found a useful conduit among a certain type of early technology adopter who have a lot of time on their hands and, tangentially, have a strong perverted desire to insert their favorite A-list celebrity or K-pop star<ref name="Dickson">{{Cite web |last=Dickson |first=EJ |date=2019-10-07 |title=Deepfake Porn Is Still a Threat, Particularly for K-Pop Stars |url=https://www.rollingstone.com/culture/culture-news/deepfakes-nonconsensual-porn-study-kpop-895605/ |access-date=2024-07-23 |website=Rolling Stone |language=en-US}}</ref> into a [[porn|pornographic]] video. Of the relatively small amount of deepfake videos on the web, 96% of them are pornography.<ref name="techreview">{{Cite web |date=2019-10-07 |title=Forget fake news—nearly all deepfakes are being made for porn |url=https://www.technologyreview.com/2019/10/07/132735/deepfake-porn-deeptrace-legislation-california-election-disinformation/ |access-date=2024-07-23 |website=MIT Technology Review |language=en}}</ref>

The most notorious deepfake application that was actually easy enough for the masses to use was, likewise, pornographic oriented: DeepNude.<ref name="Cole">{{Cite web |last=Cole |first=Samantha |date=2019-06-26 |title=This Horrifying App Undresses a Photo of Any Woman With a Single Click |url=https://www.vice.com/en/article/kzm59x/deepnude-app-creates-fake-nudes-of-any-woman |access-date=2024-07-23 |website=Vice |language=en}}</ref> Instead of swapping faces (like Zao), DeepNude swapped out bikinis that women were wearing on a beach picture that the user uploaded, and replaced it with AI generated naughty bits. Like Zao, this was relatively easy to use. The programmer quickly took down the application one day after launching it, after figuring out that, you know, an application like this is going to be pretty popular with unsavory types eager to use it to create revenge porn. Oops.<ref name="Cole1">{{Cite web |last=Cole |first=Samantha |date=2019-06-27 |title=Creator of DeepNude, App That Undresses Photos of Women, Takes It Offline |url=https://www.vice.com/en/article/qv7agw/deepnude-app-that-undresses-photos-of-women-takes-it-offline |access-date=2024-07-23 |website=Vice |language=en}}</ref>

Concern on the ability to create non-consensual pornography with deepfake technology therefore is very legitimate, and even more so when enterprising [[pedophilia|pedophiles]] take advantage of AI algorithms to churn out sexualised imagery of children and youths for them to lust upon.<ref name="wpr">{{Cite news |last=Casey |first=Evan |date=2024-05-23 |title=People using AI to create child porn is a 'growing problem,' Wisconsin AG says |url=https://www.wpr.org/news/people-using-ai-to-create-child-porn-is-a-growing-problem-wisconsin-ag-says |access-date=2024-07-23 |language=en-US}}</ref><ref name="lat">{{Cite news |last2=Instagram |last3=Email |last4=Facebook |date=2024-04-15 |title=AI-generated child pornography is circulating. This California prosecutor wants to make it illegal. |url=https://www.latimes.com/california/story/2024-04-15/ai-generated-child-pornography-is-circulating-this-california-prosecutor-wants-to-make-it-illegal |access-date=2024-07-23 |language=en-US}}</ref> While most AI technology companies such as OpenAI and ChatGPT have taken steps to curb AI child porn by detecting suspicious prompts and blocking them on sight, these have been circumvented from time to time; that being said, the mere fact that AI image generation algorithms have used datasets kanged from countless images all over the web, some of them containing photos of minors who ''definitely'' did not consent to their use, made some people leery of such art generators.

Many online communities and legislatures have already reacted to this phenomenon, with Reddit banning pornographic deepfake subreddits,<ref name="Robertson">{{Cite web |last=Robertson |first=Adi |date=2018-02-07 |title=Reddit bans ‘deepfakes’ AI porn communities |url=https://www.theverge.com/2018/2/7/16982046/reddit-deepfakes-ai-celebrity-face-swap-porn-community-ban |access-date=2024-07-23 |website=The Verge |language=en}}</ref> several legislatures rushing to make non-consensual pornographic deepfakes illegal,<ref name="tt">{{Cite web |date=2019-10-08 |title=Non-consensual deepfake porn now banned, creators can be sued $150,000 |url=https://www.tweaktown.com/news/67974/non-consensual-deepfake-porn-now-banned-creators-sued-150-000/index.html |access-date=2024-07-23 |website=TweakTown |language=en-US}}</ref><ref name="beebboob">{{Cite news |date=2019-07-02 |title=Virginia bans 'deepfakes' and 'deepnudes' pornography |url=https://www.bbc.com/news/technology-48839758 |access-date=2024-07-23 |language=en-GB}}</ref> and Pornhub taking steps to block deepfake videos… poorly.<ref name="Warzel">{{Cite web |last=Warzel |first=Charlie |date=2018-04-18 |title=Pornhub Banned Deepfake Celebrity Sex Videos, But The Site Is Still Full Of Them |url=https://www.buzzfeednews.com/article/charliewarzel/pornhub-banned-deepfake-celebrity-sex-videos-but-the-site |access-date=2024-07-23 |website=BuzzFeed News |language=en}}</ref>

===AI voice cloning===
Similar concerns were also expressed regarding deepfake audio of musicians and celebrities. Besides the obvious risk of abusing deepfake voice models for disinformation and [[hate speech]]–case in point [[4chan]] [[edgelord]] [[troll]]s using samples of {{wpl|Emma Watson}}'s voice to make it appear as though she is reciting portions of [[Adolf Hitler]]'s ''[[Mein Kampf]]''<ref>[https://fandomwire.com/internet-up-in-arms-as-4chan-user-uses-ai-voice-simulator-to-deepfake-emma-watsons-voice-makes-her-read-hitlers-autobiography/ "Internet Up in Arms as 4Chan User Uses AI Voice Simulator To Deepfake Emma Watson's Voice, Makes Her Read Hitler's Autobiography – FandomWire"]. fandomwire.com. February 2, 2023. Retrieved February 3, 2023.</ref>–a number of voice actors and musicians have voiced (pun intended) their objections to third parties synthesizing samples of their voice without their consent, such as with veteran actor {{wpl|Rick Pasqualone}} who took offense at YouTuber Mafia Game Videos using the voice of Pasqualone's character Vito Scaletta from ''{{wpl|Mafia II}}'' on a series of videos about the ''Mafia'' series, labelling the faux-Scaletta deepfake voice as "soulless" and "without any artistic merit"<ref>[https://twitter.com/rickyp66/status/1638023036103442432?s=46&t=LltcjPOVWDubS11JRmY_9A Rick Pasqualone on Twitter: "@MafiaGameVideos And this is why the future of gaming and entertainment is in danger. This is soulless and without any artistic merit. I do not approve." / Twitter]</ref> as well as ''{{wpl|Hitman (franchise)|Hitman}}'' voice actors {{wpl|David Bateson}} and Jane Perry who both voiced their opposition to an exception to a UK law effectively giving AI creators ''carte blanche'' to synthesize someone else's voice without prior approval.<ref>[https://twitter.com/TheJanePerry/status/1577679195525857280 Jane Perry on Twitter]</ref> Conversely, there are entertainers who either approve of their voice being synthesized (provided that the voice model is not used out of malice) or have had their voice cloned, such as the singer {{wpl|Grimes}} who specifically demanded she gets part of the revenue from the use of her voice, and {{wpl|Snoop Dogg}} who lent his distinctive sing-song voice to the text-to-speech service Speechify.<ref>[https://www.youtube.com/watch?v=IZov9E1GwOE Snoop Dogg Reads Dad Jokes - Speechify App Review & Demo]</ref> [[The Walt Disney Company|Disney]] animator and ''Phineas and Ferb'' series creator-slash-voice actor {{wpl|Dan Povenmire}} also publicly expressed his approval of his character Doofenshmirtz being deepfaked by enthusiasts as well.<ref>[https://www.youtube.com/watch?v=dmkXc5MvJak Doofenshmirtz TEXT-TO-VOICE-inator]</ref> Doug Cockle of ''The Witcher'' fame also expressed concern about AI voice cloning, but was also appreciative of modders who produce otherwise good-faith AI clones of his character Geralt of Rivia, stating "It's not that I want to punish modders. What they put out is, for the most part, interesting, cool fan-made stuff that just celebrates the world that they love, and that's to be celebrated. But there's a line there somewhere, and where exactly that line is what the AI debate is really, really starting to tease out of the industry." Fellow voice actor {{wpl|Cissy Jones}} came up with a company known as Ethovox (formerly Morpheme.ai) which aims to provide a compromise between entertainers and generative AI and has partnered with acting unions to ensure that their talents' voices aren't simply used indiscriminately.<ref name="Dinsdale">{{Cite web |last=Dinsdale |first=Ryan Dinsdale |last2=2023 |last3=noon |date=2023-12-22 |title=The Witcher Voice Actor Doug Cockle Calls AI 'Inevitable' but 'Dangerous' |url=https://za.ign.com/the-witcher-3/188055/news/the-witcher-voice-actor-doug-cockle-calls-ai-inevitable-but-dangerous |access-date=2024-06-05 |website=IGN Africa |language=en-za}}</ref>

As a result of the controversies surrounding AI voice models, some sites such as {{wpl|ElevenLabs}} have paywalled their voice cloning feature to mitigate potential abuse, or in the case of the community-run AI voice synthesis site Uberduck, put up a blacklist of personalities who either requested to have their voices removed from the site due to their (personal) objections, or in the case of politicians such as [[Donald Trump]], were banned outright due to even more serious risks of misinformation.<ref>[https://docs.google.com/spreadsheets/u/0/d/1n6KZpcahyckjmzgsH90ghgNs5pcEQ57baavbjAI_ed8/htmlview# Uberduck's Blacklisted/Whitelisted Voices]</ref> Uberduck previously hosted voice models of politicians on their website for the purposes of making satirical parodies using their voices, but was forced to remove them for fairly obvious reasons.

==References==
{{reflist|2|80%}}

[[Category:Artificial intelligence]]
[[Category:Deceit]]
[[Category:Technology]]

Categories: Artificial intelligence, Deceit, Technology