CNN discovered a link to an internal version of TikTok's new AI digital avatar tool without guardrails, allowing them to create videos with inappropriate content. They generated videos containing quotes from Hitler and other offensive phrases, revealing the flaw in the tool's accessibility and moderation. TikTok has since taken down the unguarded version and resolved the technical error.
CNN generated videos containing offensive content such as quotes from Hitler and a message telling people to drink bleach. They also created videos reciting Osama bin Laden's "Letter to America," a white supremacy slogan, and a video telling people to vote on the wrong day.
TikTok's new AI digital avatar tool, Symphony Digital Avatars, allows businesses to generate ads using the likeness of paid actors and AI-powered dubbing to make the avatars say what they want within TikTok's guidelines. The tool is intended to simplify content creation on the platform.