r/OpenAI • u/lulzxdxdxd • 4h ago
Discussion 1.2 million model calls, 3 benchmarks: at temperature 0, 0.07-10% of rows change between identical runs, and up to 24% on one task
https://arxiv.org/abs/2610.13823
2
Upvotes
r/OpenAI • u/lulzxdxdxd • 4h ago