So instead of adding a small llm that runs locally on the players machine, they added and api call for each instruction in the game and are racking debt. Nice design
You dont need a 5090 to run a small llm. There are 4B and 3.8B models that i used to run parallel to my games on my 3060 (the 6GB vram version mind you)
1.4k
u/black_ap3x 2d ago
So instead of adding a small llm that runs locally on the players machine, they added and api call for each instruction in the game and are racking debt. Nice design