All of Jake Arft-Guatelli's Comments + Replies

Fanaticism in AI: SERI Project

Thanks for the comment!

I do briefly discuss bounded utility functions as an objection to the argument for fanatical Superintelligences. I generally take the view that imposing bounded utility functions is difficult to do in a way that doesn't seem arbitrary—in practice this might be less of an issue as one might be able observe the agent and impose bounded functions when necessary (I think this may raise other questions, but it does seem very possible in practice).

I don't think bounded utility functions are bad intrinsically, but I do think the problems cr... (read more)