DD.pth

**DD.pth** is a mostly completed AI voice model that mimics Danny DeVito.

It was initially created as a temporary stand-in for The Lorax model; and DD's audio library was used to help further its training.

Its creation started in late July of 2023, but progress was aborted around late August when Google Colab reinforced its rules on "disallowed code"; and made it no longer possible to freely train AI models through means of the RVC-Project web UI or similar Colab templates.

There's no certainty on whether DD can or will be revisited.

## Technical details

DD was assembled through a Colab-hosted Python script, known as the RVC-Project, on standard 40k settings.

About 8 minutes of audio files were collected, of which the majority comes from movies DeVito voiced back in the 1990s. Audio with intrusive, unerasable background noise, notably low recording quality, strong echo, or other effects that altered the voice from sounding otherwise natural were not considered for use, including most live-action movies and series.

The model was only provided a few bits of dialogue, because of difficulty finding (usable) scenes online. In order to speed up training, the audio was exported in MP3 format -opposed to the often recommended, but heavier WAV.

### Used data

* Scenes from Matilda; starring the narrator (speech extraction)
* Scenes from Space Jam; starring Mr. Swackhammer (speech extraction)
* Scenes from The Simpsons; starring Herb Powell (speech extraction)
* Scenes from Last Action Hero; starring Whiskers (speech extraction)
* Scenes from The Lorax; starring The Lorax (speech extraction)
* Scenes from Kingdom Hearts; starring Phil (speech extraction)
* Scenes from Hercules; starring Phil (speech and vocal extraction)
* "They Can't Take That Away From Me" by Danny DeVito (vocal extraction)

### Voice description

DD is the best Danny DeVito model on the internet to date (2023) in terms of sound quality, but unfinished in terms of pronunciation. Though generally coherent, certain words or sentences it mistranslates.

Its sound quality is clear and decent for song mixing, though of lower quality than that of, for example, the common animation studio.

Like AI models in general at this stage (2023), it can't properly copy tracks with strong echo in them, vocals with background singers performing at the same time, or group performances/overtone singing. Occasionally, it may circumvent it, but tends to break again when the pitch strays from the average or there's a long note.

If the original singer has a particular accent, it will try to copy it. Since DeVito is an American-English speaker, the model sings foreign songs with an accent.

On the flip side, foreigners with a slight accent sound more American when they speak English through DD, unless their accent is especially strong.

## Model download

### DD

"DD", or "DDevito", is an 800 epoch model.

It contains the complete audio library and had only one revision before Colab's rule change.

**download link to model**

## Trivia

* DD is VampireMeerkat's second attempt at voice cloning.
* With there being little to no (recent) online fuss about the code restriction that prevents further development on GM, the possibility exists that the real problem concerns something Google Colab refuses to specify and is specific to VampireMeerkat.

## See also

* Nobody Needs a Thneed (Song)
* Embrace Me (Song)
* Danny DeVito model, made by 3m377
* Danny DeVito model, made by Rockn
* Danny DeVito model, made by BibbyBob
* Danny Devito model, made by merlina95 (use search engine)
* The Lorax AI