"Cyber benchmarks, while achieving an average refusal rate of 96.6% on malicious cyber requests, the highest we measure among open models."
I feel like stating the obvious here and hence like I'm missing something. Where is the statistic about not refusing the non malicious requests? I can achieve the same performance with refusing when random(1000) < 967.
rcr-anti
It's not open weight, it's weights available as they use a modified MIT license that is not OSI. It's the common "if you're serving it as a business you need a license" difference, for what it's worth.
Taek
Everyone that I know considers something to be 'open weight' if the weights are available to the public in some form or another.
In other words, I don't think there's anything misleading happening in the title. When most people discover that certain restrictions exist on using the weights, they will neither be surprised nor disappointed, because the main thing that's being advertised - the weights are available for download - is true!
dcss_gardener
Where did you get this definition of open weight and who else uses it? The weights are published. Open source is already its own more restrictive category. What would you prefer we call this kind of release?
"Weights available" does not seem to be in wide use and doesn't, to me, communicate anything different than "open weights."
rcr-anti
I didn't make it up, I'm using OSI's definition. Pretty analogous to why BSL or SSPL aren't "open".
OSI is not an authority on the topic, not more than anybody. Open Source as a concept predates its existence, and didn't even apply to LLM.
hobofan
It's the same distinction as "open source" vs "source available" (when speaking about source code). It's not that widely in use because few people in the LLM space are diligent enough with IP to make the distinction, but the concept is easily transferable.
simias
I think the problem with this "open weights" thing is that it doesn't map well at all with "open source".
If you think about it the actual mapping is more like:
- closed weight -> closed-source web service (e.g. gmail)
- open weights -> closed-source but you get the binaries (e.g. Minecraft)
- Actually open model (with training data, training pipeline etc.) -> open source
w3ll_w3ll_w3ll
I believe there should be a way to distinguish this type of open-weight model from one that you can find hosted by someone else, such as Chinese models.
stingraycharles
Isn’t this usually defined by “open” vs “free” ?
I think this is really splitting hairs, they just want to give people the ability to self-host (which is awesome) yet still make money off it for cloud based hosting.
But then again, I also always understood that startups want to prevent AWS from capitalizing on their source code as well and sympathize with Elastic, MongoDB, etc so perhaps I’m an outlier here.
Businesses should be able to release things to the public yet still be able to control who makes money off of it.
dannyw
"The requirements set forth in Section 2 do not apply to: (a) internal use of the Model or its derivative works, defined as any use that does not make the Model or its derivative works available to third parties, [...]"
Works for me. I can host it, I can run it, I can use it; but if I want to sell access to it as an inference provider, I'd have to get a license.
The economics of open-weight models has always been shaky. It's not an OSI license yes, but metaphorically it's kinda like AGPL.
Very much not open as in open source. It's a shame an organization such as OSI doesn't get out ahead of licensing of weights, what do we call this? "Weights Available" ?
rat9988
I think this open debate depends on who you talk to. Not all the people agree with this vision.
Topfi
They slashed pricing, it's now nearly half vs the preview (Input: $0.7/M Tokens, Output: $2.1/M Tokens vs Input: $1.36/M Tokens, Output: $4.18/M Tokens).
At the original pricing in my evals, Mistral Large 4 Preview was not competitive. With this price point and some improvements on top, this full release warrants a major reassessment.
seems better now, but still, it will be hard to compete. It's just that a direct comparison to frontier models will not speak to Mistrals favor.
miroljub
Why does everyone avoid publishing the most important part of the pricing while doing a comparison?
My coding sessions have a >97% input cache rate. DeepSeek got us spoiled. I am not going to use any AI provider with exorbitant or hidden cache rates.
satvikpendem
Finally, Le Chaton Fat. However, I'm not sure how well Mistral is doing in comparison to the other open-weight models, particularly Chinese ones, and I guess one would only really use Mistral if they want to have EU provenance for models.
That's really great! Congratulations to everyone working at Mistral!
Now, perhaps Kimi 3.1 is missing from the benchmarks, and Deepseek 4.1 Flash is still has impressive!
Topfi
Did I miss something, why is pricing half on this page (Input: $0.7/M Tokens, Ouput: $2.1/M Tokens) vs their API pricing page [0] (Input: $1.36/M Tokens, Output: $4.18/M Tokens).
Unrelated to Large 4, but why is it so hard to give money to Mistral? Now they finally have a model that might be worth using, but I cannot for my life figure out how to give them money and be allowed to use their model. Its really shouldn't take more than a couple of clicks to get to a payment option.
markild
I was curious about this, as I’ve seen it so many times for multiple providers, especially Mistral and Google.
Clicked sign in, was presented with a sign up form, got a free account. From there could upgrade to pro plan or pay-as-you-go.
I agree it was perhaps too hidden, but calling it hard is not fair I think.
maeln
It's as easy as going to console.mistral.ai no ?
tokai
Maybe? Its impossible to tell. I'm not going to create a user in the hope that there is a subscription service in there somewhere.
satvikpendem
> why is it so hard to give money to Mistral?
Maybe your definition of hard is much different than everyone else's...
What? It seems very doable for people who are interested in it, are you one of those people? Because it sure seems like you're trying your hardest to not find the answer yourself.
I feel like stating the obvious here and hence like I'm missing something. Where is the statistic about not refusing the non malicious requests? I can achieve the same performance with refusing when random(1000) < 967.
In other words, I don't think there's anything misleading happening in the title. When most people discover that certain restrictions exist on using the weights, they will neither be surprised nor disappointed, because the main thing that's being advertised - the weights are available for download - is true!
"Weights available" does not seem to be in wide use and doesn't, to me, communicate anything different than "open weights."
https://opensource.org/ai/open-weights
If you think about it the actual mapping is more like:
- closed weight -> closed-source web service (e.g. gmail)
- open weights -> closed-source but you get the binaries (e.g. Minecraft)
- Actually open model (with training data, training pipeline etc.) -> open source
I think this is really splitting hairs, they just want to give people the ability to self-host (which is awesome) yet still make money off it for cloud based hosting.
But then again, I also always understood that startups want to prevent AWS from capitalizing on their source code as well and sympathize with Elastic, MongoDB, etc so perhaps I’m an outlier here.
Businesses should be able to release things to the public yet still be able to control who makes money off of it.
Works for me. I can host it, I can run it, I can use it; but if I want to sell access to it as an inference provider, I'd have to get a license.
The economics of open-weight models has always been shaky. It's not an OSI license yes, but metaphorically it's kinda like AGPL.
https://huggingface.co/mistralai/Mistral-Large-4-1T-A52B/raw...
Very much not open as in open source. It's a shame an organization such as OSI doesn't get out ahead of licensing of weights, what do we call this? "Weights Available" ?
At the original pricing in my evals, Mistral Large 4 Preview was not competitive. With this price point and some improvements on top, this full release warrants a major reassessment.
[0] https://docs.mistral.ai/inference/pricing
My coding sessions have a >97% input cache rate. DeepSeek got us spoiled. I am not going to use any AI provider with exorbitant or hidden cache rates.
Now, perhaps Kimi 3.1 is missing from the benchmarks, and Deepseek 4.1 Flash is still has impressive!
[0] https://docs.mistral.ai/inference/pricing
Clicked sign in, was presented with a sign up form, got a free account. From there could upgrade to pro plan or pay-as-you-go.
I agree it was perhaps too hidden, but calling it hard is not fair I think.
Maybe your definition of hard is much different than everyone else's...
There is a subscription in there. I'm paying.