Not sure who the Quincy institute is. But can you imagine if the U.S. permanently broke open the great firewall with AGI, and media started flowing in unrestricted into China?
Or can you imagine the reverse, if China managed to hack in with ASI into the U.S. DoD's tech servers for specs on our drones and planes?
There's a gigantic amount at stake. Attacks like the Hezbollah pager attack would be almost trivial with levels of compromise enabled by a sufficiently advanced AI.
It's not clear to me the paper addresses any meaningful part of the risk and hand waves it away.
Not sure who the Quincy institute is. But can you imagine if the U.S. permanently broke open the great firewall with AGI, and media started flowing in unrestricted into China?
Or can you imagine the reverse, if China managed to hack in with ASI into the U.S. DoD's tech servers for specs on our drones and planes?
There's a gigantic amount at stake. Attacks like the Hezbollah pager attack would be almost trivial with levels of compromise enabled by a sufficiently advanced AI.
It's not clear to me the paper addresses any meaningful part of the risk and hand waves it away.
[dead]