Qwen 3.8 Flash Next Q3 S - Benchmark creation

[u/migsperez]

After running a benchmark test on Exo in Opencode and being amazed by the result, I thought I'd try other models on Opencode. Many were surprisingly terrible. Especially some mid level models.

Earlier posts:
https://www.reddit.com/r/opencode/comments/1wzm1ah/exo_free_frontier_level_wow/
https://www.reddit.com/r/opencode/comments/1ww5o7y/animated_horse_space_bunny/

Today I installed Strata on https://github.com/Niko1221/Strata

I connected up my AMD R9700 32gb with 64gb RAM and used the model Qwen3.8-Flash-Next IQ3_S. Admittedly I was expecting terrible results considering it's a small Q3. It acheived 90 tk/s decode approximately 3x compare to 27b.

I tried the usual prompt from the other posts, but the output wasn't great. So I tried iterating with a few more prompts in the hope it would improve it. The major leap was when I asked it for a plan, then asked it to build it and when I said "low poly" style but with many polygons. FYI I'd done similar with other models and the result would get worse rather than better.

Anyway I thought I'd share the output.
Qwen 3.8 Flash Next IQ3 S - https://web.esuyo.com/horse-strata-qwen-3.8-q3-s-1/

Qwen 3.8 Max - https://web.esuyo.com/horse-qwen-3.8-max/

[u/chickN00dle]

why does 3.8 Max's horse look like a galloping turd 💀

[u/netherreddit → u/chickN00dle]

He had some discs fused back in '87

[u/chickN00dle → u/netherreddit]

yeah that'd do it

[u/Redditburd]

If my horse ran like that I would have to put him down.

[u/migsperez → u/Redditburd]

Dude this is one of the gallopers of all the models. Race horse best of breed.

[u/GrimChicken → u/migsperez]

Truly one of the gallopers of all time. 

[u/Monad_Maya]

Are you trying to recreate Horsey Game - https://store.steampowered.com/app/3602570/Horsey_Game/ ?

[u/migsperez → u/Monad_Maya]

It's just a benchmark type test I use to compare different models. And to see if I can find techniques to maximise output quality.

I just clicked on the link :) funny and cute. At that price for the game maybe I should try.

[u/SheepherderSerious51]

DJ Horny Horse on the beat 🗣️🔥🐴

[u/migsperez → u/SheepherderSerious51]

Skipping around the reddits

[u/DankpawsDev]

Important to remember that different models are trained on different things to different degrees.

[u/Cautious_Chicken_604 → u/DankpawsDev]

It's actually pretty interesting to see QFNs performance on this task though. I hope local models improve at 3d modelling and animation.

[u/sloptimizer]

Solid results for a Q3, thanks for sharing!

[u/jacek2023]

You mentioned 90t/s but what was the total time of this task?

[u/Cautious_Chicken_604]

I too run like a retard.