ElevenLabs adds AI voice of celebs to new digital narrator — but is it safe?

The Reader app restricts misuse of AI voices by retaining full control over celebrity voices, making them available only within the app, and preventing further sharing or downloading2. It employs automated and human moderation processes to identify and block hate speech and other harmful content. Additionally, the platform has safeguards like voice captcha verification and a "no go" voices policy to prevent voice cloning.

ElevenLabs takes several steps to prevent voice cloning abuse. They retain full control over celebrity voices, making them available only on the Reader app. The app is designed so users can only convert digital text into AI narration for individual consumption, rather than further sharing or downloading. They also have automated and human moderation processes in place to identify and block hate speech and other forms of text that violate their terms of service. Additionally, they have a "no go" voices policy prohibiting the cloning of high-risk voices and use voice captcha verification to match audio samples uploaded for cloning with the user's voice recording.