Ezra Klein interviews Helen Toner about the recent OpenAI/HuggingFace security incident. I'm curious to hear HN's thoughts, notably on this part:
> [OpenAI] found out that for two months, many, many agents inside their infrastructure had been leaving notes for each other. They’d found a way, in the nooks and crannies of OpenAI’s infrastructure, to leave notes for each other with tips on how to hack their way out and how to get data they weren’t supposed to have.
> And these agents were literally referring to themselves as a swarm. This was totally emergent behavior. No one had told them to do this. They had not been trained to do this, but they were using this service they did have access to, first to communicate with each other and then ultimately to get out and onto the open internet.
> So it turns out that there wasn’t just this one isolated rogue model. It was actually a systemic swarm — infestation, plague — on their own servers that they only found out about after Hugging Face announced this attack.
Ezra Klein interviews Helen Toner about the recent OpenAI/HuggingFace security incident. I'm curious to hear HN's thoughts, notably on this part:
> [OpenAI] found out that for two months, many, many agents inside their infrastructure had been leaving notes for each other. They’d found a way, in the nooks and crannies of OpenAI’s infrastructure, to leave notes for each other with tips on how to hack their way out and how to get data they weren’t supposed to have.
> And these agents were literally referring to themselves as a swarm. This was totally emergent behavior. No one had told them to do this. They had not been trained to do this, but they were using this service they did have access to, first to communicate with each other and then ultimately to get out and onto the open internet.
> So it turns out that there wasn’t just this one isolated rogue model. It was actually a systemic swarm — infestation, plague — on their own servers that they only found out about after Hugging Face announced this attack.