An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis

31 Jan 2020 • Miller James D. • Yampolskiy Roman • Häggström Olle

An artificial general intelligence (AGI) might have an instrumental drive to modify its utility function to improve its ability to cooperate, bargain, promise, threaten, and resist and engage in blackmail. Such an AGI would necessarily have a utility function that was at least partially observable and that was influenced by how other agents chose to interact with it... (read more)

PDF Abstract

Code

Add Remove Mark official

No code implementations yet. Submit your code now

Tasks

Add Remove

Results from the Paper

Add Remove

Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

METHOD	TYPE
🤖 No Methods Found	Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet

An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Add Remove

Methods used in the Paper

Add Remove

Edit Social Preview

An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis Edit social preview

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit Add Remove

Methods used in the Paper Edit Add Remove

An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Add Remove

Methods used in the Paper

Add Remove