Go Back
Choose this branch
Choose this branch
meritocratic
regular
democratic
hot
top
alive
38 posts
Oracle AI
Self Fulfilling/Refuting Prophecies
Bounties (closed)
Parables & Fables
16 posts
AI Boxing (Containment)
Acausal Trade
Superrationality
Values handshakes
Computer Security & Cryptography
Verification
291
The Parable of Predict-O-Matic
abramdemski
3y
42
60
Prize for probable problems
paulfchristiano
4y
63
58
Results of $1,000 Oracle contest!
Stuart_Armstrong
2y
2
57
Contest: $1,000 for good questions to ask to an Oracle AI
Stuart_Armstrong
3y
156
55
Proper scoring rules don’t guarantee predicting fixed points
Johannes_Treutlein
4d
2
47
Counterfactual Oracles = online supervised learning with random selection of training episodes
Wei_Dai
3y
26
29
Self-Supervised Learning and AGI Safety
Steven Byrnes
3y
9
26
Training goals for large language models
Johannes_Treutlein
5mo
5
24
Reflective oracles as a solution to the converse Lawvere problem
SamEisenstat
4y
0
22
Analysing: Dangerous messages from future UFAI via Oracles
Stuart_Armstrong
3y
16
22
Oracles, sequence predictors, and self-confirming predictions
Stuart_Armstrong
3y
0
20
Oracles: reject all deals - break superrationality, with superrationality
Stuart_Armstrong
3y
4
18
Cooperative Oracles
Diffractor
4y
9
18
Standard ML Oracles vs Counterfactual ones
Stuart_Armstrong
4y
5
142
Decision theory does not imply that we get to have nice things
So8res
2mo
53
54
Cryptographic Boxes for Unfriendly AI
paulfchristiano
12y
162
41
Superrational Agents Kelly Bet Influence!
abramdemski
1y
5
35
Side-channels: input versus output
davidad
8d
9
25
Breaking Oracles: superrationality and acausal trade
Stuart_Armstrong
3y
15
24
Safely and usefully spectating on AIs optimizing over toy worlds
AlexMennen
4y
16
21
Superrationality in arbitrary games
Vanessa Kosoy
7y
0
16
"Fully" acausal trade
Stuart_Armstrong
3y
2
3
Acausal trade: double decrease
Stuart_Armstrong
5y
0
0
Acausal trade: being unusual
Stuart_Armstrong
5y
0
0
Acausal trade: different utilities, different trades
Stuart_Armstrong
5y
0
0
Acausal trade: Introduction
Stuart_Armstrong
5y
0
0
Acausal trade: full decision algorithms
Stuart_Armstrong
5y
0
0
Acausal trade: universal utility, or selling non-existence insurance too late
Stuart_Armstrong
5y
0