kbog comments on Current Estimates for Likelihood of X-Risk? - Effective Altruism Forum

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (18)

You are viewing a single comment's thread.

Comment author: kbog  (EA Profile) 06 August 2018 11:29:26PM *  0 points [-]

don't forget the doomsday argument.

https://arxiv.org/abs/1705.08807 has a question about the probability that the outcome of AI will be "extremely bad."

Where in the Stern report are you looking?

Comment author: Carl_Shulman 07 August 2018 01:25:14AM 7 points [-]

The fixed 0.1% extinction risk is used as a discount rate in the Stern report. That closes the model to give finite values (instead of infinite benefits) after they exclude pure temporal preference discounting on ethical grounds. Unfortunately, the assumption of infinite confidence in a fixed extinction rate, gives very different (lower) expected values than a distribution that accounts for the possibility of extinction risks eventually becoming stably low for long periods (the Stern version gives a probability of less than 1 in 20,000 to civilization surviving another 10,000 years, when agriculture is already 10,000 years old).