r/LocalLLaMA • • 16h ago

Resources Qwen released QwenGyre - RL framework for training AI agents on extremely long complex tasks

Introducing QwenGyre, bringing elastic RL to extreme-long-horizon (XLong) agent training.

It launches with two core designs:

- Elastic Scheduler: reallocates GPUs between rollout & training as demand shifts—live executions never interrupted. Up to 1.85× speedup over Colocate, 1.78× over Async.

- Trajectory Processor: turns branching executions (compaction, sub-agents, retries) into prefix-shared trajectory trees with bounded, deduplicated training samples. Partial progress after timeout still gets scored.

Scaled to Qwen3.8-2.4T-A95B with ~700K tokens per rollout, QwenGyre lifts NL2RepoBench from 52.5% to 58.5% in 48 steps, cutting end-to-end training time by ~44% vs Async.

🔗 Read the paper:

arxiv.org/abs/2609.33848

441 Upvotes

41 comments sorted by

•

u/WithoutReason1729 12h ago

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

89

u/DAlmighty 16h ago

These guys are just too good.

58

u/Mysterious_Finish543 15h ago

... NL2RepoBench with Qwen 3.6 122B over training steps 1–42...

We evaluate QWENGYRE on ... using Qwen 3.6 122B.

The paper mentions Qwen3.6-122B 14 times. So many people were asking for that model here in r/LocalLLaMa.

3

u/Makers7886 4h ago

Those bastards

1

u/zanar97862 1h ago

Interesting they didn't choose to release it, or maybe it's just a typo

15

u/BVCC6FNTKX sglang 13h ago

Qwen 4 gonna be fire I just know it

36

u/Dany0 16h ago

Now we can train agentic monsters at home

We just need to pool compute

41

u/GalacticDistances 15h ago

Great idea, Ill DM you an address to ship your hardware to

19

u/rahulkadukar 13h ago

Here is my address 127.0.0.1 OR :::1 in case you want IPv6

19

u/OttoRenner 13h ago

What a coincidence, we live in the same house!

11

u/This_Technology9841 12h ago

Oh hi roomies

4

u/GalacticDistances 10h ago

I think our main breaker tripped..

12

u/gnoremepls 15h ago

Let's do this and also prove some random math problem while were at it.

6

u/notheresnolight 15h ago

I'm willing to lend the entire computing power of my Radxa Q6A

12

u/lolwutdo 13h ago

I pray for Qwen 4 this week

6

u/Bulky-Priority6824 13h ago

rip that $6500 i been hanging on to, better buy now stuff like this will spike prices and demand once again.

5

u/Elouakili_Flexy 10h ago

Qwen releases the model, then the framework, then the GPU cluster. Meanwhile we're still pooling compute in this thread.

11

u/xNaXDy 14h ago

Is the "G" in "Gyre" pronounced like the "G" in "gif" or like the "G" in "regex"? 🤔

7

u/n4pst3r3r 13h ago

The g in regex is obviously silent, otherwise it would be gregex.

3

u/ii-___-ii 13h ago

Or the "g" in gyro

3

u/ResidentPositive4122 13h ago

It first depends on how you pronounce the g in gif :D

3

u/ongrabbits 8h ago

I choose to pronounce it as Qwen Girl

1

u/Objective_Safe_5982 13h ago

Or G as in giraffe.

1

u/uniquelyavailable 11h ago

Like the G in gigantic, of course.

1

u/PcChip 13h ago

but.. officially, those two are pronounced the same aren't they?

-2

u/[deleted] 13h ago

[deleted]

6

u/jfinkpottery 13h ago

if you weren't a bot you'd recognize a joke

2

u/knownboyofno 14h ago

I made something like this but I couldn't get several runs at the same time without problems with timing. I was only focused on code.

1

u/bahwi 1h ago

Hmm, no source code? I need to try this for training

-2

u/Porespellar 14h ago

QwenGyre….Qwen-Guy-Ray?….Qwen-Gee-Ruh…. Quagmire??? I got nothin’ guys 🤷‍♂️

10

u/DarthFader4 14h ago

Idk if you're just joking but it's pronounced like Jie-er, rhymes with "buyer". It's a term for a circulating system, like big ocean currents.

2

u/Porespellar 12h ago

Thank you!! I honestly had no idea and was genuinely curious!

1

u/sxlstrale 1h ago

Llai-er

1

u/Dreeew84 10h ago

Giggity

1

u/NoahFect 8h ago

Turning and turning in the widening gyre / The falcon cannot hear the falconer

1

u/SnooPeppers3873 34m ago

sorry if it's unrelated, simple question, but I really need a system that would train me on long context coding tasks, I just want to do tasks I don't want to plan, I just want to code and then get graded on the code just like the LLM, is that even possible?