Go Back
Choose this branch
Choose this branch
meritocratic
regular
democratic
hot
top
alive
50 posts
Reinforcement Learning
Inverse Reinforcement Learning
Road To AI Safety Excellence
23 posts
Wireheading
Reward Functions
286
Reward is not the optimization target
TurnTrout
4mo
97
11
AGIs may value intrinsic rewards more than extrinsic ones
catubc
1mo
6
22
A Survey of Foundational Methods in Inverse Reinforcement Learning
adamk
3mo
0
80
Jitters No Evidence of Stupidity in RL
1a3orn
1y
18
26
Is CIRL a promising agenda?
Chris_Leong
6mo
12
21
RLHF
Ansh Radhakrishnan
7mo
5
29
Scalar reward is not enough for aligned AGI
Peter Vamplew
11mo
3
55
My take on Michael Littman on "The HCI of HAI"
Alex Flint
1y
4
70
Thoughts on "Human-Compatible"
TurnTrout
3y
35
62
Book Review: Human Compatible
Scott Alexander
2y
6
71
RAISE is launching their MVP
3y
1
12
Multi-Agent Inverse Reinforcement Learning: Suboptimal Demonstrations and Alternative Solution Concepts
sage_bergerson
1y
0
36
Learning biases and rewards simultaneously
Rohin Shah
3y
3
37
AI Safety Prerequisites Course: Basic abstract representations of computation
RAISE
3y
2
7
Note on algorithms with multiple trained components
Steven Byrnes
6h
1
45
A Short Dialogue on the Meaning of Reward Functions
Leon Lang
1mo
0
26
generalized wireheading
carado
1mo
7
75
Seriously, what goes wrong with "reward the agent when it makes you smile"?
TurnTrout
4mo
41
19
An investigation into when agents may be incentivized to manipulate our beliefs.
Felix Hofstätter
3mo
0
47
Reward model hacking as a challenge for reward learning
Erik Jenner
8mo
1
20
Reinforcement Learner Wireheading
Nate Showell
5mo
2
8
Reward IS the Optimization Target
Carn
2mo
3
43
Draft papers for REALab and Decoupled Approval on tampering
Jonathan Uesato
2y
2
13
$100/$50 rewards for good references
Stuart_Armstrong
1y
5
176
Are wireheads happy?
Scott Alexander
12y
107
20
Wireheading and discontinuity
Michele Campolo
2y
4
24
Thoughts on reward engineering
paulfchristiano
3y
30
15
Defining AI wireheading
Stuart_Armstrong
3y
9