Go Back
Choose this branch
You can't go any further
meritocratic
regular
democratic
hot
top
alive
30 posts
Outer Alignment
Mesa-Optimization
46 posts
Inner Alignment
61
Paper: Constitutional AI: Harmlessness from AI Feedback (Anthropic)
LawrenceC
4d
10
81
Trying to Make a Treacherous Mesa-Optimizer
MadHatter
1mo
13
32
The Speed + Simplicity Prior is probably anti-deceptive
7mo
29
22
Three questions about mesa-optimizers
Eric Neyman
8mo
5
23
[ASoT] Some thoughts about deceptive mesaoptimization
leogao
8mo
5
137
Risks from Learned Optimization: Introduction
evhub
3y
42
76
"Inner Alignment Failures" Which Are Actually Outer Alignment Failures
johnswentworth
2y
38
116
List of resolved confusions about IDA
Wei_Dai
3y
18
6
Inner alignment: what are we pointing at?
lcmgcd
3mo
2
7
Alignment as Game Design
Shoshannah Tekofsky
5mo
7
71
An Increasingly Manipulative Newsfeed
Michaël Trazzi
3y
16
10
Mesa-utility functions might not be purely proxy goals
Thomas Kwa
8mo
17
38
Mesa-Optimizers vs “Steered Optimizers”
Steven Byrnes
2y
7
71
Prize for probable problems
paulfchristiano
4y
63
84
Inner and outer alignment decompose one hard problem into two extremely hard problems
TurnTrout
18d
18
41
Mesa-Optimizers via Grokking
orthonormal
14d
4
28
Take 8: Queer the inner/outer alignment dichotomy.
Charlie Steiner
11d
2
19
Value Formation: An Overarching Model
Thane Ruthenis
1mo
6
60
How likely is deceptive alignment?
evhub
3mo
21
22
Greed Is the Root of This Evil
Thane Ruthenis
2mo
4
36
Broad Picture of Human Values
Thane Ruthenis
4mo
5
42
Outer vs inner misalignment: three framings
Richard_Ngo
5mo
4
94
Selection Theorems: A Program For Understanding Agents
johnswentworth
1y
23
165
Inner Alignment: Explain like I'm 12 Edition
Rafael Harth
2y
46
38
[Intro to brain-like-AGI safety] 10. The alignment problem
Steven Byrnes
8mo
4
28
Clarifying the confusion around inner alignment
Rauno Arike
7mo
0
77
Discussion: Objective Robustness and Inner Alignment Terminology
jbkjr
1y
7
68
Empirical Observations of Objective Robustness Failures
jbkjr
1y
5