The company behind this,
@inworld_ai
, uses
@elevenlabsio
to source its voices.
Anyone can synthesize a voice on Elevenlabs. Your voice could be on Elevenlabs and you'd never know it. You could be used for a video game without compensation or your permission. I hate it here.
It’s not just me right? This AI character 100% sounds like it’s based off Erica Lindbeck (Jesse from FF7 remake/Magilou from Tales of Berseria/Futaba from Persona 5)
I’m almost certain they didn’t get
@ericalindbeck
’s permission to base the sound off her voice clips or likeness.
@inworld_ai
@elevenlabsio
This is how easy it is. Only one minute of clean audio needed. They say you have to "have rights" to a voice you clone, but how can they police that? They say "only you have access to the voices you create" but does your voice go towards helping "randomly generate" new voices?
@akaGhostBird
@inworld_ai
Hey - these voices are 100% synthetic. That means you’re hearing a completely novel, AI-generated voice. Any resemblance will be purely coincidental!
@elevenlabsio
@inworld_ai
The voices can’t come from nothing. What is your system trained on? When you generate a voice, what does the system use to create the voice? We know you don’t stop people from uploading actor’s voices, so what’s stopping your system from generating voices based on their data?
@akaGhostBird
@inworld_ai
@elevenlabsio
A huge shame to hear this. It’s a testament to someone’s voice acting that they have such recognisable work, but such a shame how that can be exploited and monetised. It has gone beyond “what if” arguments - job opportunities are actively being replaced by AI now already :/
@Evanz111
@inworld_ai
@elevenlabsio
It's so disheartening, esp. when you start looking at the structure of Elevenlabs now. IIRC, back in the early days of it, people were uploading celeb voices to clone them for fun. Now it's more locked-down, but you can "randomly generate" voices. What does it generate FROM? ...
@akaGhostBird
@inworld_ai
@elevenlabsio
6 months ago I told Eleven Labs that my voice was being used on their site without my consent, and they brushed me off. They’re a disgusting service.
@stephaniesheh
@stealcase
@elevenlabsio
They are “tools,” but not in the sense they mean. It’s the outcome of years of celebrating a vision of freedom w/o responsibility, of valuing disruption w/out considering the disrupted, of asking for forgiveness rather than permission. This path has a bad ending. Let’s change it.
@akaGhostBird
@inworld_ai
@elevenlabsio
Just one of the many, MANY problems with AI. It is not concerned with laws, permissions, or ethics (a problem which also seems to plague many of those developing AI).
@akaGhostBird
@TeeDotally
@inworld_ai
@elevenlabsio
It's so infuriating; I've considered several legitimate uses for the technology that I don't mention anywhere, because it would still end up being abused, like this. And I'm not even a VA. People who support this never ask themselves what will happen when THEIR jobs are AI'd.