To me the current scariest thing about AI is not that the AI itself will be malevolent. It's how humans might use it.

Why does a country need people? To provide productivity - i.e., gather resources, build and invent things.

Now imagine we build AGI or ASI that can replace all human work (including robots that can perform all physical tasks).

Suddenly, the productivity value of a human being drops to 0.

One person can now form their own "country," with robots that can harvest food, build defenses, and build more robots.

Of course, humans don't like to live alone. So maybe there will be small societies of a couple hundred people.

The question is: what happens to everyone else? There will be no incentive to provide UBI to everyone if human beings no longer contribute economic value. In fact, there won't be a need for an economy. All resources can be obtained through robots.