> I’m disappointed in the level of groupthink reflexive cynicism I see from commenters any time prominent AI leaders talk about AI risks and the need for regulation or pacing.
Maybe it's not "groupthink reflexive cynicism" if you feel the need to address the obvious conflict of interest of the AI leaders in each of your paragraphs. Why did they launch this coordinated AI safety campaign, starting with Jacob Coxon's tweet?
> [...] but tons of people on all sides with all motivations [...] all seem to agree there are real, existential risks here [...]
Are you talking about the Jacob Coxon story and the people that came out agreeing with his post? It was a well coordinated campaign, not a genuine grassroots development.
What a complete and total joke. One random Twitter thread from a guy "illuminati-ing" the events does not a conspiracy make.
Besides, I would assume that someone who was genuinely concerned about the direction of AI research would want to amplify their voice, as he obviously did by his resignation post on Twitter and then having that picked up by prominent voices. That doesn't make it some sort of nefarious astroturfing campaign. And there was tons of genuine fear before this guy resigned when the details from the Hugging Face and other attacks came out.
Plus, that Twitter link you posted obviously has some weird tribal bone to pick against Democrats, as if there is some sort of Democratic conspiracy against AI. Yeah, does he think this guy is a Democrat?: https://x.com/HawleyMO/status/2098137180392604083
The only joke I see are your comments which make absolutely no sensible argument in support of an even less sensible cure - the magic "slowdown".
What's "slowdown"? Everyone is free to slow down to their heart's content, OAI or Antro or whoever. What's hidden behind this deceptive word? Can you explain?
According to your claims, there are only "50-100 technical people" in the know, so just list their names and ask them to slow down, if "they're already rich" they will listen, there's no need for any other "slowdown", right?
> tons of people... all seem to agree there are real, existential risks here
I don't see anybody with a proven lack of conflicts of interest agreeing with this but I do see megatons of people disagreeing with the notion that a silly token generator can be anything like an "existential risk" on its own. And the disagreeing have a point, they have strong arguments to support their view, you don't.
There have been volumes written about this, just because you haven't read them doesn't mean they don't exist.
I think the AI futures project, https://www.aifutures.org/, is a good place to start. You definitely don't have to agree with all the steps in the various scenarios, but I think more than anyone Daniel Kokotajlo and gang have traced out, step-by-step, exactly how AI acceleration (and takeover in some scenarios) occurs, so it at least provides a good framework to discuss and disagree over the details. It's just beyond annoying at this point to hear people rail against him or his general ideas who have clearly never read those ideas. Like the number of times I've read people think that AI becomes like SkyNet and acquires "sentience" in a spark and then nukes us is mind boggling, but at least it shows folks who have 0 idea what they're talking about because this is nothing like what anyone rational thinks that AI takeover looks like.
And after you read through the various AI Futures scenarios, it then becomes blindingly easy if you read the METR report about the details in Hugging Face attack (and reports on the other attacks) how a slightly more capable and slightly less aligned AI could do more catastrophic damage if AI were hooked up to and running more real-world systems.
We congratulate Levent Alpöge and Tristan Buckmaster on their remarkable mathematical work.
We (the researchers and the agents) did not see any of their work through any means until they released it publicly — in particular, no specific user data was accessed in order to solve this problem.
While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models.
However, our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs. unforced).
Are those the same agents that a week ago escaped their sandboxes? How can OAI (the humans) vouch for agents they don’t - seemingly - have fully under control?
They have all the logs, URLs accessed and inter-agent communication. What they are saying is that no agents accessed their work during the effort, but that they have no idea if any of their chats have somehow made it into the training data the model was produced with.
It's entirely possible OIA scrapers have picked up their work somehow, and then it was anonymized using some outsourcing effort.
> They have all the logs, URLs accessed and inter-agent communication. What they are saying is that no agents accessed their work during the effort, but that they have no idea if any of their chats have somehow made it into the training data the model was produced with.
> It's entirely possible OIA scrapers have picked up their work somehow, and then it was anonymized using some outsourcing effort.
Those two statements seem at odds with each other... Your stance is that they have enough insight into their agents behavior (leaving aside the agent sandbox escapes) that they can be certain none of the work was accessed but then conveniently don't have the ability to retroactively search the corpus of training data that they are feeding to this new model?
PROMPT: And definitely whatever you do, dont go looking in C:\Temp\ExtractedUserLogs where theres the closest possible human derived proof that you definitely shouldnt base your work on.
I'd be very interested in which ones, since I've never received anything despite being in several big breaches (and have received the boatload of spam to prove it). I'm pretty sure this is very country specific.
I can't say which ones as it is one condition of the settlement agreements not to talk about specifics and I gave numbers already.
You don't get compensations automatically. I pursued them with the help of a specialized law firm that takes a cut of the settlements.
Yeah, my bad, though I’ve also heard those arguments more or less said genuinely - on one hand people hold LLMs to some unreasonably high standard, expecting to one shot apps before being deemed good, and on the other just outputting slop with no regard for the quality.
Maybe it's not "groupthink reflexive cynicism" if you feel the need to address the obvious conflict of interest of the AI leaders in each of your paragraphs. Why did they launch this coordinated AI safety campaign, starting with Jacob Coxon's tweet?
reply