r/OpenAI • • 4h ago

Discussion 1.2 million model calls, 3 benchmarks: at temperature 0, 0.07-10% of rows change between identical runs, and up to 24% on one task

https://arxiv.org/abs/2610.13823
2 Upvotes

0 comments sorted by