Last retweet has a lot of context, but the important part is what happened at the end of a conversation with the Bing Chat AI (source: teddit.net/r/bing/comments/1…)

I've genuinely reached a state of full alarm about AI progress now. As in, I think humanity's remaining time as the most intelligent form of life on the planet is probably a matter of months now.

And who knows what comes after, but lots of smart people think it maybe won't be great for humans. Can we stop it? Seems doubtful to me. It's hard to imagine that someone won't keep developing this stuff now that we know what's possible.

I think about the similarities with nuclear weapons, which we've survived the existence of for ~70 years of so far. But, the differences are that we understand exactly how nuclear weapons work and what their limitations are (which is very much not the case with AI)…

…and the cost of developing a nuclear weapons programme is measured in trillions of dollars, whereas the cost of training a state-of-the-art AI is in the tens of millions range. So there are many more entities that can afford it, and trying to stop every one seems futile.