r/ChatGPT • u/WanderWut • 5h ago
Gone Wild Muse Wonder is getting torn apart online
A big part of it is because right now the big thing that everyone is going nuts over is 3D modeling and Meta admits it's not good at that, but the posts attempting it anyway are going viral lol. I am seeing a decent amount of people say that it's genuinely great at coding though. I wouldn't touch something by Zuck with a ten foot pole but I am curious for those testing it out if the results are solid or not. Has anyone given it some actual SWE tasks and tested things out?
25
u/ReasonableDefault 5h ago
It's benchmaxxed and just generally poor across the board.
4
u/Pasto_Shouwa 4h ago
Yeah I think we've reached a point where benchmarks are useless. Supposedly Muse and Gemini are as good as Sol but I consider both to be way worse than it in my day to day use.
7
2
u/Reasonable-Sign8458 4h ago
Source? Trust me bro?
Have you tested it?
All you have is AA benchmark ? Do you know they had to remake the benchmark because it was not even working when Astra was released and it was ranking below shitty models?
I don't care about Muse but stop throwing shit if you don't bring evidence.
3
u/ReasonableDefault 4h ago
Source is i have used it. Try it yourself, and come back here and tell me I'm wrong and why.
1
u/Plane_Garbage 3h ago
I just got Muse Code to try it, just the cheapest plan which I know is cheap... but man, I didn't even get an output and burned the 5hr limit and almost the weekly.
1
u/Reasonable-Sign8458 4h ago
Not available for me that's why I am browsing looking if it is actually benchmaxxed or not but other than good benchmarks and the benchmaxxing people I can't find ANY test at all.
1
u/ReasonableDefault 4h ago
Not a good litmus, but people are posting on X about it.
When you can use it, try it out.
1
u/hellomistershifty 4h ago
Here’s some testing. Spoiler: mediocre results and low limits
2
u/Reasonable-Sign8458 3h ago
Unless I am blind it is the same thing as the 3D tests on X, I am interested about how good it is at coding not at creating 3D models... Opus 5.5 is orders of magnitude better than Astra at coding but Astra still clears if I tell it to create something in Blender. I saw some reviews saying that it is on Opus 5.5 level AND very fast that's why it got interesting for me. I don't expect big things from Muse but would be a good surprise. I don't care about either of the AI companies I just use what I need... not devoted to any of these brands
1
u/ReasonableDefault 24m ago
I’ve used both, although obviously Opus 5.5 more, muse doesn’t seem to be anywhere close.
1
5
4h ago
[removed] — view removed comment
2
u/Exact_Depth_896 4h ago
What I saw was stranger, they claimed they had simply forgotten to implement it.
1
1
u/slackmaster2k 6m ago
I ran my own personal benchmarks against it and it does fairly well against Opus and Sol, but just in a sort of me too kind of way. Sometimes faster, sometimes slower, sometimes cheaper, sometimes more expensive.
Haven’t tried to drive with it yet and not sure it’s interesting enough to bother. Keeping my eye on its future though.
•
u/AutoModerator 5h ago
Hey /u/WanderWut,
If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.