Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal Sony video reveals ongoing experimentation with AI-powered PlayStation characters. The Verge reported on this video, allegedly from PlayStation Studios' advanced technology group, showcasing Aloy from the *Horizon* series as an AI-driven character. The video's removal from YouTube following a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client) suggests its authenticity. IGN has reached out to Sony for comment.

According to The Verge, the video features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. The technology employed includes OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) system, and Sony's Mockingbird technology for facial animation. The resulting AI Aloy, however, uses a robotic voice distinct from voice actor Ashly Burch's portrayal, and exhibits stiff, lifeless facial movements.

The conversation covers Aloy's well-being and her quest to find her mother, with the AI responding appropriately within the established *Horizon* narrative. The demo seamlessly transitions into the *Horizon Forbidden West* game world, allowing Raghoebardajal to continue the conversation while playing. This juxtaposition highlights the potential and the current limitations of the technology.

The demo, a prototype developed with Guerrilla Games, serves as an internal demonstration of Sony's AI capabilities. While showcasing Sony's investment in AI-powered characters, the company hasn't confirmed plans for public integration of this technology, nor its feasibility within current PS5 games. However, this research aligns with industry trends, as competitors like Microsoft (with its Muse AI) are also heavily investing in AI for game development.

Generative AI's role in gaming is a hot topic, particularly given recent industry layoffs. While facing ethical and rights concerns, and struggling to consistently produce enjoyable content (as evidenced by Keywords Studios' failed AI-driven game), major players like EA (which considers AI "the very core" of its business) and Capcom (experimenting with generative AI for environment creation) are actively exploring its potential. Asad Qizilbash of PlayStation Productions and PlayStation Studios highlights the importance of AI-driven personalization for Gen Z and Gen Alpha gamers, emphasizing the potential for more meaningful and personalized in-game interactions.

Activision's recent admission of using generative AI for some *Call of Duty: Black Ops 6* assets, amidst criticism of an AI-generated loading screen, further underscores the ongoing debate surrounding AI's role in game development.

### What's The Best PlayStation 5 Game?

### Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results