> Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage)
And who pays for that botnet's tokens? And then decides to just let it keep racking up bills?
> ... even when this gets us accused of hype, “doomerism”, or regulatory capture.
I wonder why...
> The first step is something Anthropic is unilaterally committing to (and calls on governments to require other frontier companies to match).
> The US and other democratic governments attempt to coordinate with authoritarian governments, to the extent this is possible [...]
Narrator: it's not.
We probably shouldn't have immature doomsday cult members in charge of very powerful technology, but that's where we are, and I'm still looking forward to cheap RAM when the bubble pops.
https://darioamodei.com/post/we-must-pace-the-frontier
Sjors Provoost
npub1v2…qexw3
2026-09-13 08:15:39 UTC
Author Public Key
npub1v25jqj332n630klwtqeqxgyrjl4alw4phmluhu2x6lcxzwy9m03suqexw3Seen on
wss://relay.damus.ioPublished at
2026-09-13 08:15:39 UTCEvent JSON
{
"id": "24745b74e6d0983af3047d5883b57f42bb19a4fcad1bb4f4ea7d4688ae67060a",
"pubkey": "62a9204a3154f517dbee583203208397ebdfbaa1beffcbf146d7f0613885dbe3",
"created_at": 1789287339,
"kind": 1,
"tags": [
[
"r",
"https://darioamodei.com/post/we-must-pace-the-frontier"
],
[
"client",
"Damus"
]
],
"content": "\u003e Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage)\n\nAnd who pays for that botnet's tokens? And then decides to just let it keep racking up bills?\n\n\u003e ... even when this gets us accused of hype, “doomerism”, or regulatory capture.\n\nI wonder why...\n\n\u003e The first step is something Anthropic is unilaterally committing to (and calls on governments to require other frontier companies to match). \n\n\u003e The US and other democratic governments attempt to coordinate with authoritarian governments, to the extent this is possible [...]\n\nNarrator: it's not.\n\nWe probably shouldn't have immature doomsday cult members in charge of very powerful technology, but that's where we are, and I'm still looking forward to cheap RAM when the bubble pops.\n\nhttps://darioamodei.com/post/we-must-pace-the-frontier",
"sig": "48e8d48abc704125f2bb0da7e510c436d8e53abb435fb76513ed48d7f2ca2e5a09a8a9847ce8a62fe2ada89197b1069fd8d8befa4de91fab3d30c8deabe6a986"
}