Ai 2040 and the offhand mentioning of "human brain uploads"

gonna start with saying I am personally a detractor of AI but I dont think my detraction is going to do anything to stop this

went down the AI 2040 rabbithole and one part of it that I barely see anyone discussing is that the authors don't just talk about AGI, automation, robots, etc. They repeatedly bring up whole brain emulation and uploaded humans as something that could become relevant surprisingly soon after sufficiently powerful AI exists. I dont think people have really thought how weird our world could fucking get world gets if that works.

yes I know its not a prophecy its like a hypothetical scenario or whatever. but I have been thinking a LOT about this

AI 2040's Space Governance Plan straight-up talks future populations of "digital minds," saying these could include AI systems or simulated human brains. In their Plan A scenario, they think that by around 2040 there could potentially be huge numbers of digital minds, some with stable preferences, human or superhuman intelligence and possibly subjective experience. this is very scary to me.

They even discuss what happens when you copy them. If I upload myself and then duplicate the me onto another computer, are there now two of me? Do both get a vote? If not, how different does Copy #2 have to become before she's legally a separate person????

This has had me thinking a LOT about the ethics of all this but also how WEIRD and unrecognizable the world could be in lets say, 30 years time, if this stuff becomes normal. Like not even different in a 1920-2020 way but more like 6000 bce to now way. why would uploaded humans have to live inside humanoid robot bodies or Matrix-style virtual worlds?

you could have "human": cars, spacecraft, buildings, ships, drones, fucking FRIDGES, toys, clothing. you could have people attempting to merge with eachother, hackers could "steal" your grandpa, or copy him. would copying be considered theft atp? whats stopping someone from having a private data center with a whole civilization of copied people living fake lives. I doubt work would matter anymore but god, will anything matter?

I dont trust capitalism with this at all I will say that. I dont want to be serving digital prison sentences, or community service where I am forced to work as a cleaning robot. I know some of this seems illogical and honestly I dont think it will happen but there is always a chance that it will. are you ready for weird evangelical christian cults that merge themselves into one supreme being? this is stuff that not even people from the 50s could comprehend, and I bet people will do things that I cant comprehends with this.