Search Results for author:
Found 8 papers, 1 papers with code
Path-Specific Objectives for Safer Agent Incentives
We then train agents to maximize the causal effect of actions on the expected return which is not mediated by the delicate parts of state, using Causal Influence Diagram analysis.
Too Big to Fail? Active Few-Shot Learning Guided Logic Synthesis
Generating sub-optimal synthesis transformation sequences ("synthesis recipe") is an important problem in logic synthesis.
A Complete Criterion for Value of Information in Soluble Influence Diagrams
Influence diagrams have recently been used to analyse the safety and fairness properties of AI systems.
Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness
In addition to reproducing discriminatory relationships in the training data, machine learning systems can also introduce or amplify discriminatory effects.
Agent Incentives: A Causal Perspective
We propose a new graphical criterion for value of control, establishing its soundness and completeness.
The Incentives that Shape Behaviour
Which variables does an agent have an incentive to control with its decision, and which variables does it have an incentive to respond to?
(When) Is Truth-telling Favored in AI Debate?
For some problems, humans may not be able to accurately judge the goodness of AI-proposed solutions.
Incorrigibility in the CIRL Framework
We demonstrate this by presenting some Supervised POMDP scenarios in which errors in the parameterized reward function remove the incentive to follow shutdown commands.
