Go Back
Choose this branch
Choose this branch
meritocratic
regular
democratic
hot
top
alive
123 posts
Interpretability (ML & AI)
Myopia
Self Fulfilling/Refuting Prophecies
AI Success Models
Lottery Ticket Hypothesis
Conservatism (AI)
Luck
Market making (AI safety technique)
Verification
123 posts
Instrumental Convergence
Corrigibility
Deconfusion
Orthogonality Thesis
Treacherous Turn
Gradient Hacking
Mild Optimization
Quantilization
Satisficer
Gradient Descent
Tripwire
338
A Mechanistic Interpretability Analysis of Grokking
Neel Nanda
4mo
39
211
The Plan - 2022 Update
johnswentworth
19d
33
159
The Singular Value Decompositions of Transformer Weight Matrices are Highly Interpretable
beren
22d
27
144
Self-fulfilling correlations
PhilGoetz
12y
50
139
Opinions on Interpretable Machine Learning and 70 Summaries of Recent Papers
lifelonglearner
1y
16
136
MIRI comments on Cotra's "Case for Aligning Narrowly Superhuman Models"
Rob Bensinger
1y
13
136
A transparency and interpretability tech tree
evhub
6mo
10
135
Understanding “Deep Double Descent”
evhub
3y
51
123
How "Discovering Latent Knowledge in Language Models Without Supervision" Fits Into a Broader Alignment Scheme
Collin
5d
18
123
Interpreting Neural Networks through the Polytope Lens
Sid Black
2mo
26
118
Deep Learning Systems Are Not Less Interpretable Than Logic/Probability/Etc
johnswentworth
6mo
52
118
The case for becoming a black-box investigator of language models
Buck
7mo
19
112
Conversation with Eliezer: What do you want the system to do?
Akash
5mo
38
106
A Longlist of Theories of Impact for Interpretability
Neel Nanda
9mo
29
205
Debate on Instrumental Convergence between LeCun, Russell, Bengio, Zador, and More
Ben Pace
3y
60
170
Sorting Pebbles Into Correct Heaps
Eliezer Yudkowsky
14y
109
153
Seeking Power is Often Convergently Instrumental in MDPs
TurnTrout
3y
38
118
Soares, Tallinn, and Yudkowsky discuss AGI cognition
So8res
1y
35
111
Interpretability/Tool-ness/Alignment/Corrigibility are not Composable
johnswentworth
4mo
8
109
Let's See You Write That Corrigibility Tag
Eliezer Yudkowsky
6mo
67
105
A broad basin of attraction around human values?
Wei_Dai
8mo
16
99
Gradient hacking
evhub
3y
39
93
Goal retention discussion with Eliezer
MaxTegmark
8y
26
88
Coherence arguments imply a force for goal-directed behavior
KatjaGrace
1y
27
73
A Gym Gridworld Environment for the Treacherous Turn
Michaël Trazzi
4y
9
72
Instrumental convergence is what makes general intelligence possible
tailcalled
1mo
11
69
Satisficers Tend To Seek Power: Instrumental Convergence Via Retargetability
TurnTrout
1y
8
65
When to use quantilization
RyanCarey
3y
5