Rendered at 21:44:21 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
qalmakka 18 hours ago [-]
Both OpenAI and Anthropic are locked into an arms race funded on shaky hype-based debt. They have to constantly push the envelope at the frontier or risk seeing their funding pulled, probably causing a global financial crash in the process which would kill them.
Clearly they've realised that people are increasingly fine with non-frontier models, including Chinese ones. They can't consolidate and just deliver a product to profit because they're constantly being caught up by the Chinese at prices they will never be able to match.
I suspect their main goal for the last year and a half or so was to pull a GM - let the share of the AI economy grow, then have the government bail them out when the debt becomes unsustainable. Clearly Trump would have never let the bubble explode before the midterms, right?
Well it's now clear that the US government has way too much debt right now for 2008-style bailouts, and the market doesnt have the money lying around to buy their overinflated stocks at an IPO. The only avenue realistically left to them is to cry wolf so much to get governments to ban all non-approved models, stop new developments and give them breathing room to consolidate to get their current crop of models profitable at higher prices.
Unfortunately for them I suspect Mr President has way too much dementia and way to little business acumen left to realise the sham going on, so I think they'll keep doing charades for a while until they'll suddenly stop
simianwords 16 hours ago [-]
This line of conspiracy theory is sooo uninteresting.
“It’s all hype”
“Government bailouts”
“Labs are fundamentally unprofitable”
And the same people who say all this will again claim OpenAI should be held responsible and arrested for when agents hack other systems.
It’s a fundamentally unthoughtout analysis. If you believe that OpenAI should be more careful and prevent future hugging face incidents, surely their decision to delay models is rational? Does it really require tinfoil analysis?
What would you say when their models cause new incidents like hugging face one?
qalmakka 14 hours ago [-]
I think that the economic side of things of how those businesses are run, and the fact AI has potential to be an incredibly powerful tool, are orthogonal concepts. I don't see how the fact an LLM can be used, autonomously or directly, to perform hacking or penetrate computer systems, has to do with the fact that there's clearly an interest from those labs in being strictly regulated while dictating the rules they should respect in the first place. I suspect such regulations will be surprisingly difficult to implement for anyone but the existing US-based labs, and of course it will be super surprising when it turns out that since the federal government stopped everybody from making new frontier models they suddenly got super profitable.
> What would you say when their models cause new incidents like hugging face on
What would you say if Caterpillar builds a bulldozer with a faulty breaking system that kills people? I'd hold them responsible because they failed to oversee the development of their product like every responsible company should do. If they're so much in a hurry to ship that they can't even test what they're building properly, they must be held responsible for that - and I say this as one of their customers and users, not as a random Joe that dislikes LLMs. LLMs are useful but it's undeniable that these labs are clearly desperately trying to keep the lights on no matter the consequences
simianwords 12 hours ago [-]
> If they're so much in a hurry to ship that they can't even test what they're building properly, they must be held responsible for that - and I say this as one of their customers and users, not as a random Joe that dislikes LLMs
You are replying to a post where they are doing exactly that. But you analysed it as if they are secretly in a cash crunch and trying to keep the lights on.
You and I both agree that delaying release is the rational response.
What's the necessity for the conspiracy theory, when the simple explanation is that they are delaying the release for safety reasons?
qalmakka 7 hours ago [-]
> secretly in a cash crunch
What's secret in the fact that literally they've never had a single positive quarter yet, and we're a rack of GPUs being repossesses away from going from a bull to a bear market? Their entire business is based on getting financing from VC, and they've been keeping the lights on by pushing any narrative they could to sustain the hype. Regulatory capture isn't really a conspiracy theory, it's the very exact thing multiple companies in their position have done in the past to avoid a market readjustment they knew they'd lose
DrScientist 13 hours ago [-]
Models like this are in effect dual use - just like computers and computer programmes in general. Ethercap is a very useful debugging tool - and can also be used for exploits.
We don't ban Ethercap, we police the use - just like with all dual use stuff.
If OpenAI is directing the software ( how ever badly ) that's hacking - OpenAI is responsible, it's not the fault of the software.
Note if somebody else is using OpenAI models to generate code to hack - that's not OpenAI's responsibility it's the person using and running the generated code.
simianwords 12 hours ago [-]
> Note if somebody else is using OpenAI models to generate code to hack - that's not OpenAI's responsibility it's the person using and running the generated code.
No, I don't think a company can get away from releasing a powerful tool that can cause disruption if used poorly. This is just not how society works.
The reality is that labs will get blamed for things people do using it. And they have - look at any news about US Army using Claude etc
DrScientist 11 hours ago [-]
Things can be regulated in sensible countries where the things are pretty much single use - like guns.
However, nobody bans cars because somebody has driven one into a crowd, or hammers because of a particularly grusome murder.
These models, just like computers, are universal tools by their nature - they don't fall into the gun category - they fall into the hammer and car category.
simianwords 5 hours ago [-]
> Things can be regulated in sensible countries where the things are pretty much single use - like guns.
Sure and there are regulations on who can own guns and licenses. And that's literally how Mythos is handed out today - to trusted partners. What is your opinion about that?
Also, companies are not allowed to release stuff like Nuclear technology, chemical weapons etc. These literally can't be regulated and a single adversary can use it destructively.
"but but they are just tools ok" doesn't work when the capability is big enough.
Look, it might be easy sitting behind a computer asking OpenAI to release whatever new model because you personally don't think you will be affected. But the society needs to be careful on what it hands potential adversaries.
Ekaros 12 hours ago [-]
There is plenty of commercial hacking tools. And those seem to survive just fine.
Issue really isn't that these models can be used for something.
Issue is that they have been used for something with such disregard of any even slightly reasonable oversight that everyone in executive team, board and every shareholder should be in jail just now...
simianwords 12 hours ago [-]
what have they done that they require jail?
DrScientist 13 hours ago [-]
The other point is if their new model isn't safe, doesn't that mean all their previous models aren't safe as well?
ie if they were truly being 'responsible' they would pull the lot....
That's what makes people think it's not genuine.
simianwords 12 hours ago [-]
> The other point is if their new model isn't safe, doesn't that mean all their previous models aren't safe as well?
This understanding comes from the fact that people think either models are fundamentally unsafe or they are completely safe. The reality is that there are different levels of alignment possible. So it is really a tradeoff between effort/time taken to align the model and speed of release.
DrScientist 11 hours ago [-]
From their own Astra press release.
>Compared to GPT‑5.6 Sol, which without production safeguards went beyond the authorized target 48% of the time, GPT‑6 Astra did this in 0% of cases.
Is Sol still available?
I assume the production safeguards ( filtering prompts and responses ) is fairly transportable between models.
simianwords 11 hours ago [-]
Bigger models require better alignment. So I would assume that the newer models will undergo more stringent alignment checks. For instance, I wouldn't put that much effort on GPT 4.
Why would you expect something else?
DrScientist 11 hours ago [-]
So you are telling me Sol can't be used for hacking?
Please...
Also think about it - they are 'announcing' a delay.
They didn't need to do that - they can just release when ready - nobody is expecting them to release a new model on a certain date.
The whole thing is confected.
ffrr1 10 hours ago [-]
He’s a booster in psychosis - look at his post history.
He often makes remarks then runs away when confronted. He doesn’t act in good faith.
simianwords 5 hours ago [-]
> So you are telling me Sol can't be used for hacking?
Who said anything about hacking? You can use it, but it is very restricted. But a much more capable model must have much higher restrictions on alignment. Obviously you wouldn't need to spend too much on alignment on a 3B gemma model. This must be obvious, I'm not sure why you bring this up?
> They didn't need to do that - they can just release when ready - nobody is expecting them to release a new model on a certain date.
Again a conspiracy theory? People expected a model during Dev Day. And they are just setting expectations. Whats with you guys and conspiracy theories?
ffrr1 10 hours ago [-]
Your posts wreak of desperation.
SupLockDef 7 hours ago [-]
You have some kool-aid on your shirt, you should drink more carefully.
Clearly they've realised that people are increasingly fine with non-frontier models, including Chinese ones. They can't consolidate and just deliver a product to profit because they're constantly being caught up by the Chinese at prices they will never be able to match.
I suspect their main goal for the last year and a half or so was to pull a GM - let the share of the AI economy grow, then have the government bail them out when the debt becomes unsustainable. Clearly Trump would have never let the bubble explode before the midterms, right?
Well it's now clear that the US government has way too much debt right now for 2008-style bailouts, and the market doesnt have the money lying around to buy their overinflated stocks at an IPO. The only avenue realistically left to them is to cry wolf so much to get governments to ban all non-approved models, stop new developments and give them breathing room to consolidate to get their current crop of models profitable at higher prices.
Unfortunately for them I suspect Mr President has way too much dementia and way to little business acumen left to realise the sham going on, so I think they'll keep doing charades for a while until they'll suddenly stop
“It’s all hype”
“Government bailouts”
“Labs are fundamentally unprofitable”
And the same people who say all this will again claim OpenAI should be held responsible and arrested for when agents hack other systems.
It’s a fundamentally unthoughtout analysis. If you believe that OpenAI should be more careful and prevent future hugging face incidents, surely their decision to delay models is rational? Does it really require tinfoil analysis?
What would you say when their models cause new incidents like hugging face one?
> What would you say when their models cause new incidents like hugging face on
What would you say if Caterpillar builds a bulldozer with a faulty breaking system that kills people? I'd hold them responsible because they failed to oversee the development of their product like every responsible company should do. If they're so much in a hurry to ship that they can't even test what they're building properly, they must be held responsible for that - and I say this as one of their customers and users, not as a random Joe that dislikes LLMs. LLMs are useful but it's undeniable that these labs are clearly desperately trying to keep the lights on no matter the consequences
You are replying to a post where they are doing exactly that. But you analysed it as if they are secretly in a cash crunch and trying to keep the lights on.
You and I both agree that delaying release is the rational response.
What's the necessity for the conspiracy theory, when the simple explanation is that they are delaying the release for safety reasons?
What's secret in the fact that literally they've never had a single positive quarter yet, and we're a rack of GPUs being repossesses away from going from a bull to a bear market? Their entire business is based on getting financing from VC, and they've been keeping the lights on by pushing any narrative they could to sustain the hype. Regulatory capture isn't really a conspiracy theory, it's the very exact thing multiple companies in their position have done in the past to avoid a market readjustment they knew they'd lose
We don't ban Ethercap, we police the use - just like with all dual use stuff.
If OpenAI is directing the software ( how ever badly ) that's hacking - OpenAI is responsible, it's not the fault of the software.
Note if somebody else is using OpenAI models to generate code to hack - that's not OpenAI's responsibility it's the person using and running the generated code.
No, I don't think a company can get away from releasing a powerful tool that can cause disruption if used poorly. This is just not how society works.
The reality is that labs will get blamed for things people do using it. And they have - look at any news about US Army using Claude etc
However, nobody bans cars because somebody has driven one into a crowd, or hammers because of a particularly grusome murder.
These models, just like computers, are universal tools by their nature - they don't fall into the gun category - they fall into the hammer and car category.
Sure and there are regulations on who can own guns and licenses. And that's literally how Mythos is handed out today - to trusted partners. What is your opinion about that?
Also, companies are not allowed to release stuff like Nuclear technology, chemical weapons etc. These literally can't be regulated and a single adversary can use it destructively.
"but but they are just tools ok" doesn't work when the capability is big enough.
Look, it might be easy sitting behind a computer asking OpenAI to release whatever new model because you personally don't think you will be affected. But the society needs to be careful on what it hands potential adversaries.
Issue really isn't that these models can be used for something.
Issue is that they have been used for something with such disregard of any even slightly reasonable oversight that everyone in executive team, board and every shareholder should be in jail just now...
ie if they were truly being 'responsible' they would pull the lot....
That's what makes people think it's not genuine.
This understanding comes from the fact that people think either models are fundamentally unsafe or they are completely safe. The reality is that there are different levels of alignment possible. So it is really a tradeoff between effort/time taken to align the model and speed of release.
>Compared to GPT‑5.6 Sol, which without production safeguards went beyond the authorized target 48% of the time, GPT‑6 Astra did this in 0% of cases.
Is Sol still available?
I assume the production safeguards ( filtering prompts and responses ) is fairly transportable between models.
Why would you expect something else?
Please...
Also think about it - they are 'announcing' a delay.
They didn't need to do that - they can just release when ready - nobody is expecting them to release a new model on a certain date.
The whole thing is confected.
He often makes remarks then runs away when confronted. He doesn’t act in good faith.
Who said anything about hacking? You can use it, but it is very restricted. But a much more capable model must have much higher restrictions on alignment. Obviously you wouldn't need to spend too much on alignment on a 3B gemma model. This must be obvious, I'm not sure why you bring this up?
> They didn't need to do that - they can just release when ready - nobody is expecting them to release a new model on a certain date.
Again a conspiracy theory? People expected a model during Dev Day. And they are just setting expectations. Whats with you guys and conspiracy theories?
So what’s the trick in this honestly? OpenAI shouldn’t care about alignment and just release it? I’m genuinely asking.