Unfortunately I think the technology hasn't gotten that far. Especially if you have long conversations, you'll definitely start to see issues where things fall out of the context bin, instructions get deprioritized or over-prioritized, or the original prompt gets lost.
Even relying on more modern tricks like leveraging a persistent external store for information eventually seems to grow the information beyond a model's ability to handle well, which makes sense. Conversations can traverse a pretty infinite space.
I think it could work okay for very limited interactions. I think it'll be super disappointing for art.
I think it could be interesting to treat AI NPC’s context window as their memory. It makes sense that characters forget things you say to them after a while, so the game could be designed to make the context window less game breaking or immersion breaking
It's not a terrible idea, but I think what's likely is that the npc is supposed to know things like "hide that you're a spy", and suddenly they forget that they're supposed to hide it, but their historical prompts are full of messages about "You're a spy, but you didn't mention it."
Or "You know about X thing happening because you're a spy, but you ask about it anyways."
As long as the game runs a custom model, they can control the context tokens to always keep crucial information like that.
I do agree with you that with today’s technology it would likely cause unintentional game breaking situations. But it’s theoretically possible to have an immersive game like this
32
u/ShellTrajectory 1d ago
Unfortunately I think the technology hasn't gotten that far. Especially if you have long conversations, you'll definitely start to see issues where things fall out of the context bin, instructions get deprioritized or over-prioritized, or the original prompt gets lost.
Even relying on more modern tricks like leveraging a persistent external store for information eventually seems to grow the information beyond a model's ability to handle well, which makes sense. Conversations can traverse a pretty infinite space.
I think it could work okay for very limited interactions. I think it'll be super disappointing for art.