Go Back
Choose this branch
You can't go any further
meritocratic
regular
democratic
hot
top
alive
30 posts
Outer Alignment
Mesa-Optimization
46 posts
Inner Alignment
195
Risks from Learned Optimization: Introduction
evhub
3y
42
93
Trying to Make a Treacherous Mesa-Optimizer
MadHatter
1mo
13
72
List of resolved confusions about IDA
Wei_Dai
3y
18
61
[AN #58] Mesa optimization: what it is, and why we should care
Rohin Shah
3y
9
59
Paper: Constitutional AI: Harmlessness from AI Feedback (Anthropic)
LawrenceC
4d
10
53
An Increasingly Manipulative Newsfeed
Michaël Trazzi
3y
16
52
Mesa-Optimizers vs “Steered Optimizers”
Steven Byrnes
2y
7
49
Prize for probable problems
paulfchristiano
4y
63
46
"Inner Alignment Failures" Which Are Actually Outer Alignment Failures
johnswentworth
2y
38
42
The Steering Problem
paulfchristiano
4y
12
42
Weak arguments against the universal prior being malign
X4vier
4y
23
28
The Speed + Simplicity Prior is probably anti-deceptive
7mo
29
28
The Disastrously Confident And Inaccurate AI
Sharat Jacob Jacob
1mo
0
25
[ASoT] Some thoughts about deceptive mesaoptimization
leogao
8mo
5
185
Inner Alignment: Explain like I'm 12 Edition
Rafael Harth
2y
46
112
Selection Theorems: A Program For Understanding Agents
johnswentworth
1y
23
108
Inner and outer alignment decompose one hard problem into two extremely hard problems
TurnTrout
18d
18
105
The Inner Alignment Problem
evhub
3y
17
98
Demons in Imperfect Search
johnswentworth
2y
21
84
How likely is deceptive alignment?
evhub
3mo
21
82
Tessellating Hills: a toy model for demons in imperfect search
DaemonicSigil
2y
17
80
2-D Robustness
vlad_m
3y
8
78
Open question: are minimal circuits daemon-free?
paulfchristiano
4y
70
75
A simple environment for showing mesa misalignment
Matthew Barnett
3y
9
63
Discussion: Objective Robustness and Inner Alignment Terminology
jbkjr
1y
7
58
Empirical Observations of Objective Robustness Failures
jbkjr
1y
5
56
Concrete experiments in inner alignment
evhub
3y
12
46
Towards an empirical investigation of inner alignment
evhub
3y
9