Modder wires ChatGPT into Skyrim VR so NPCs can roleplay and remember past conversations

Spend enough time in any RPG and you’ll eventually run out of things to talk about with its characters. But what if they had a never-ending supply of dynamically generated anecdotes? What if you could ask them questions that weren’t listed on a menu in front of you? What if they could even remember the experiences they’ve had with you in the game, and could talk about them at length? Those are the questions modder Art From The Machine is trying to answer in Skyrim VR.

In the video below you can see some scenes from the work-in-progress mod, which uses OpenAI’s large language model ChatGPT to generate responses, xVASynth for text-to-speech so the NPCs can be fully voiced, and Whisper for speech-to-text, so players can speak into their mic and the NPCs can understand them.