Go Back
Choose this branch
Choose this branch
meritocratic
regular
democratic
hot
top
alive
38 posts
Oracle AI
Self Fulfilling/Refuting Prophecies
Bounties (closed)
Parables & Fables
16 posts
AI Boxing (Containment)
Acausal Trade
Superrationality
Values handshakes
Computer Security & Cryptography
Verification
258
The Parable of Predict-O-Matic
abramdemski
3y
42
72
Prize for probable problems
paulfchristiano
4y
63
67
Results of $1,000 Oracle contest!
Stuart_Armstrong
2y
2
60
Contest: $1,000 for good questions to ask to an Oracle AI
Stuart_Armstrong
3y
156
57
Counterfactual Oracles = online supervised learning with random selection of training episodes
Wei_Dai
3y
26
43
Proper scoring rules don’t guarantee predicting fixed points
Johannes_Treutlein
4d
2
36
Self-Supervised Learning and AGI Safety
Steven Byrnes
3y
9
32
Reflective oracles as a solution to the converse Lawvere problem
SamEisenstat
4y
0
28
Oracles: reject all deals - break superrationality, with superrationality
Stuart_Armstrong
3y
4
27
Analysing: Dangerous messages from future UFAI via Oracles
Stuart_Armstrong
3y
16
27
Oracles, sequence predictors, and self-confirming predictions
Stuart_Armstrong
3y
0
25
Training goals for large language models
Johannes_Treutlein
5mo
5
21
Cooperative Oracles
Diffractor
4y
9
21
Standard ML Oracles vs Counterfactual ones
Stuart_Armstrong
4y
5
145
Decision theory does not imply that we get to have nice things
So8res
2mo
53
65
Cryptographic Boxes for Unfriendly AI
paulfchristiano
12y
162
48
Superrational Agents Kelly Bet Influence!
abramdemski
1y
5
35
Side-channels: input versus output
davidad
8d
9
33
Safely and usefully spectating on AIs optimizing over toy worlds
AlexMennen
4y
16
29
Superrationality in arbitrary games
Vanessa Kosoy
7y
0
28
Breaking Oracles: superrationality and acausal trade
Stuart_Armstrong
3y
15
22
"Fully" acausal trade
Stuart_Armstrong
3y
2
4
Acausal trade: double decrease
Stuart_Armstrong
5y
0
0
Acausal trade: being unusual
Stuart_Armstrong
5y
0
0
Acausal trade: different utilities, different trades
Stuart_Armstrong
5y
0
0
Acausal trade: Introduction
Stuart_Armstrong
5y
0
0
Acausal trade: full decision algorithms
Stuart_Armstrong
5y
0
0
Acausal trade: universal utility, or selling non-existence insurance too late
Stuart_Armstrong
5y
0