Go Back
Choose this branch
You can't go any further
meritocratic
regular
democratic
hot
top
alive
10 posts
Solomonoff Induction
Priors
Occam's Razor
37 posts
Inner Alignment
1
Simplicity priors with reflective oracles
Benya_Fallenstein
8y
0
16
The universal prior is malign
paulfchristiano
6y
0
59
When does rationality-as-search have nontrivial implications?
nostalgebraist
4y
11
132
A Semitechnical Introductory Dialogue on Solomonoff Induction
Eliezer Yudkowsky
1y
34
64
Learning the prior
paulfchristiano
2y
29
134
The Solomonoff Prior is Malign
Mark Xu
2y
52
25
Learning the prior and generalization
evhub
2y
16
18
Clarifying Consequentialists in the Solomonoff Prior
vlad_m
4y
16
33
Occam's Razor May Be Sufficient to Infer the Preferences of Irrational Agents: A reply to Armstrong & Mindermann
Daniel Kokotajlo
3y
39
19
Instrumental Occam?
abramdemski
2y
15
102
Inner and outer alignment decompose one hard problem into two extremely hard problems
TurnTrout
18d
18
20
Value Formation: An Overarching Model
Thane Ruthenis
1mo
6
26
Applications for Deconfusing Goal-Directedness
adamShimi
1y
3
28
Mesa-Optimizers via Grokking
orthonormal
14d
4
65
Threat Model Literature Review
zac_kenton
1mo
4
127
Externalized reasoning oversight: a research direction for language model alignment
tamera
4mo
22
41
Framing AI Childhoods
David Udell
3mo
8
42
Outer vs inner misalignment: three framings
Richard_Ngo
5mo
4
43
Towards an empirical investigation of inner alignment
evhub
3y
9
77
2-D Robustness
vlad_m
3y
8
20
Inner alignment requires making assumptions about human values
Matthew Barnett
2y
9
16
Re-Define Intent Alignment?
abramdemski
1y
33
72
A simple environment for showing mesa misalignment
Matthew Barnett
3y
9
175
Inner Alignment: Explain like I'm 12 Edition
Rafael Harth
2y
46