That is a very fair point! I guess even within human laws there is some point before “God-level” where the “automation overhang” is reduced when AI becomes so good that it can compete with the product/services of many companies end-to-end rather than relying on integration into business processes. Still, I think it’s fair to say that a) business integration can be/is a bottleneck to automation and b) “automation overhang” differs between products/service based on market structure (eg lower in management consulting, higher in public transport)
I have no idea what superintelligence following existing laws even looks like.
Take mind uploading. Is it
Murder
A (currently unapproved) medical procedure
Not something the law makes any mention of, so permitted by default.
The current law is very vague with respect to tech that doesn’t exist yet. And there are a few laws which, depending on interpretation, might be logically impossible to follow.
ASI by default pushes right to the edge of what is technically possible, not a good fit with vague rules.
You are raising good questions, though they are probably beyond the scope for me to answer. My high-level take would be that there are quite a few existing laws that could apply in such a scenario (eg Neuralink-implants to record brain-activity need FDA approval) and that we should expect laws to be adapted to new circumstances caveated with the pacing problem.
That is a very fair point! I guess even within human laws there is some point before “God-level” where the “automation overhang” is reduced when AI becomes so good that it can compete with the product/services of many companies end-to-end rather than relying on integration into business processes. Still, I think it’s fair to say that a) business integration can be/is a bottleneck to automation and b) “automation overhang” differs between products/service based on market structure (eg lower in management consulting, higher in public transport)
I have no idea what superintelligence following existing laws even looks like.
Take mind uploading. Is it
Murder
A (currently unapproved) medical procedure
Not something the law makes any mention of, so permitted by default.
The current law is very vague with respect to tech that doesn’t exist yet. And there are a few laws which, depending on interpretation, might be logically impossible to follow.
ASI by default pushes right to the edge of what is technically possible, not a good fit with vague rules.
You are raising good questions, though they are probably beyond the scope for me to answer. My high-level take would be that there are quite a few existing laws that could apply in such a scenario (eg Neuralink-implants to record brain-activity need FDA approval) and that we should expect laws to be adapted to new circumstances caveated with the pacing problem.