In part 1, I discussed how I used Artificial Intelligence (A.I.) to turn a Star Trek inspired fan script that I wrote back in 2010 into an audio drama featuring the voices of Spock and McCoy. I utilized ElevenLabs‘ voice synthesis algorithm to convert sound clips captured from a variety of sources into a series of back-and-forth dialog between the two characters. Ultimately, I wound up with an approximately 15-minute long audio drama.
Part 2 covered how I managed to take the audio drama and turn it into an animated fan film with the help of an amazing illustrator by the name of MATT SLADE, music composer MATT MILNE, and my longtime childhood friend MOJO. Indeed, in the end, I was the only person involved in this production whose named didn’t start with the letter M! The finished product came out looking like this…
And now the moment that I am certain many of you have been waiting for: the legal and moral questions of “Can Jonathan legally do this?” and “Should Jonathan ethically do this?” These are both complex subjects to tackle. But let’s dive in…!
In part 1, I explained how I had used Artificial Intelligence (A.I.) to synthesize the voices of Spock and McCoy to speak the words of a script I originally wrote as a short story back in 2010. In it, Captain Kirk has just “died” saving the U.S.S. Enterprise-B (in the feature film Star Trek Generations), and Bones is getting angry-drunk mourning the untimely passing of his longtime friend. Spock finds McCoy sitting alone in an unnamed bar and offers to join him. It’s the last thing the doctor wants—a Vulcan with no emotions—but, ironically, the thing he most needs. And Spock needs McCoy, as well, even though the Vulcan would never openly admit it.
The story was always intended to be a sort of a two-actor stage play, simple but poignant, giving a glimpse into how these two longtime friends and colleagues deal with the loss of AN ABSENT FRIEND. But the story/script sat quietly on my hard-drive for more than a decade, unused and mostly unpublished, waiting for its “moment.”
That moment came when I discovered the ElevenLabs website (thank you, RAY MYERS!), which can generate synthesized speech from any decent voice sample of a minute or two. Assembling verbal snippets from LEONARD NIMOY and DeFOREST KELLEY from various sources, I set out to create an audio drama of my script. The project took me a couple of months, and I explained the nuances of how I did it in part 1.
Now in part 2, I’ll explain how I got from that audio drama to this completely animated Star Trek fan film…
As I mentioned in part 1, after I completed the audio drama, I was frustrated by the subtle inconsistencies between sentences (especially for McCoy) due to my generating the voices in short segments. This was a necessary evil due to the limitations of the early A.I. technology, but it still bothered me.
While some Star Trek fan films have begun to Artificial Intelligence ( A.I.) in limited ways to age and de-age characters and also to create brief visuals and short bits of dialog, my new animated fan film AN ABSENT FRIEND is the first time that A.I. speech synthesis has been used to generate ALL of the voices. And what’s more, two of those voices are sampled from the late LEONARD NIMOY and DeFOREST KELLEY, allowing the beloved characters of Spock and McCoy to live on.
The obvious question that might come to mind for some people would be: Is this legal? The short answer is “yes…at least for now.” That could change in the not-too-distant future, but no law governing or restricting the A.I. generation of a deceased actor’s voice in a fan film exists at the moment. I will dive more deeply into the legal status of voice A.I. in Part 3 of this blog series (along with the ethical considerations). However, right now in Part 1, I would like to discuss how I managed to digitally recreate the voices of these two deeply-missed actors, and in Part 2, I’ll be covering how I and my illustrator, MATT SLADE, turned an audio drama into a full animated Star Trek fan film.
First, though, let’s take a look at this groundbreaking project…
ARTIFICIAL INTELLIGENCE TAKING OVER THE WORLD?
A.I. has exploded across the planet in the last year and a half, and it’s certainly become a bit of a mixed bag. The term itself is an umbrella for a wide range of digital breakthroughs whereby computers are doing some incredible—and occasionally worrisome—things. A.I. is being used for everything from generating business presentations and news articles to writing millions of lines of computer code in seconds. A.I. digitally de-aged an 80-year-old HARRISON FORD in the fifth and final Indiana Jones feature film last year and also completed an unfinished Beatles song despite two of the original band members having died decades ago.
Law enforcement is using intuitive software to sift through endless social media postings to track down wanted suspects and potential terrorists. On the other side of the moral spectrum, however, some students are using A.I. software to write their school essays for them, while a few political campaigns have begun to generate false images and articles to spread realistic-looking fake news to unsuspecting voters. Earlier this year, a New Hampshire robocall seemingly from Joe Biden that told Democrats not to “waste their vote” in the primary was actually faked by a supporter of one of the other primary candidates. And of course, the recent Hollywood writers and actors strikes worried that A.I. would make many of their jobs all but irrelevant.
My own mind was blown last year when I saw A.I. used to create an actual Star Trek fan film! THE RODDENBERRY ARCHIVE released the following short fan film featuring a deepfaked face of Leonard Nimoy as Spock put onto the body of actor LAWRENCE SELLECK…
