Ah, thanks, I have read a little bit of Searching for Safety in the past, but had forgotten about this.
I largely agree with this approach. The one problem is when dealing with catastrophic risks, you can’t afford to have an error. In the case of existential risk, there is literally no way to learn or recover from mistakes. In general the worse the risk, the more you need careful analysis and planning up front.
Ah, thanks, I have read a little bit of Searching for Safety in the past, but had forgotten about this.
I largely agree with this approach. The one problem is when dealing with catastrophic risks, you can’t afford to have an error. In the case of existential risk, there is literally no way to learn or recover from mistakes. In general the worse the risk, the more you need careful analysis and planning up front.