It appears that Sony is making significant strides in integrating artificial intelligence into its gaming experiences. A recent leak revealed that the company has developed an AI prototype capable of embodying Horizon Forbidden West’s Aloy, allowing users to engage in conversational interactions with the character. While only Aloy has been showcased in this early test, the technology could eventually extend to other iconic PlayStation characters like Kratos, Joel, and Ellie.
Although details of Sony’s AI endeavors have been kept under wraps, this demonstration suggests the company, like others in the industry, is actively developing AI models. The Microsoft Muse AI model, for example, was trained on Ninja Theory’s Bleeding Edge to create playable game versions aimed at preserving older titles. Now, it appears that Sony is developing its own approach to AI.
The leaked video, which surfaced following an anonymous tip, features Sharwin Raghoebardajal, a Sony Interactive Entertainment software engineering director, conversing with the AI-powered Aloy. This AI version of Aloy was created in collaboration with Guerrilla Games, the developer of Horizon Forbidden West.
During the conversation, Raghoebardajal asks Aloy how she is, receives a response, and proceeds to engage with the character about her backstory, referencing key moments from the Horizon games. To accomplish this, Sony utilized OpenAI’s Whisper for speech-to-text, GPT-4 for language processing, Meta’s Llama 3, and Sony’s own technology called Emotional Voice Synthesis. This combination facilitates two-way conversations, allowing the AI to interpret user input and respond with expressive vocal and facial reactions.
Despite the video’s mixed reception, copyright enforcement firm Muso, acting on behalf of Sony, took down the source. Speculation abounds regarding PlayStation’s potential applications for this technology. The AI model of Aloy can answer questions about the world she inhabits, adding depth and details from the game’s narrative.
One potential application would be an interactive way for players to revisit or catch up on the stories, allowing them to refresh their memories or fill in any gaps they may have. In a more practical application, it could replace or work with the PS5 Game Help feature, and might also be employed for events or exhibitions. It’s currently unknown exactly what future plans might bring, as it seems Sony isn’t presently ready to unveil this technology to the public.
