Go Back
Choose this branch
Choose this branch
meritocratic
regular
democratic
hot
top
alive
38 posts
Oracle AI
Self Fulfilling/Refuting Prophecies
Bounties (closed)
Parables & Fables
16 posts
AI Boxing (Containment)
Acausal Trade
Superrationality
Values handshakes
Computer Security & Cryptography
Verification
55
Proper scoring rules don’t guarantee predicting fixed points
Johannes_Treutlein
4d
2
291
The Parable of Predict-O-Matic
abramdemski
3y
42
26
Training goals for large language models
Johannes_Treutlein
5mo
5
58
Results of $1,000 Oracle contest!
Stuart_Armstrong
2y
2
57
Contest: $1,000 for good questions to ask to an Oracle AI
Stuart_Armstrong
3y
156
47
Counterfactual Oracles = online supervised learning with random selection of training episodes
Wei_Dai
3y
26
60
Prize for probable problems
paulfchristiano
4y
63
29
Self-Supervised Learning and AGI Safety
Steven Byrnes
3y
9
22
Analysing: Dangerous messages from future UFAI via Oracles
Stuart_Armstrong
3y
16
20
Oracles: reject all deals - break superrationality, with superrationality
Stuart_Armstrong
3y
4
22
Oracles, sequence predictors, and self-confirming predictions
Stuart_Armstrong
3y
0
24
Reflective oracles as a solution to the converse Lawvere problem
SamEisenstat
4y
0
18
Standard ML Oracles vs Counterfactual ones
Stuart_Armstrong
4y
5
18
Cooperative Oracles
Diffractor
4y
9
35
Side-channels: input versus output
davidad
8d
9
142
Decision theory does not imply that we get to have nice things
So8res
2mo
53
41
Superrational Agents Kelly Bet Influence!
abramdemski
1y
5
25
Breaking Oracles: superrationality and acausal trade
Stuart_Armstrong
3y
15
16
"Fully" acausal trade
Stuart_Armstrong
3y
2
24
Safely and usefully spectating on AIs optimizing over toy worlds
AlexMennen
4y
16
54
Cryptographic Boxes for Unfriendly AI
paulfchristiano
12y
162
21
Superrationality in arbitrary games
Vanessa Kosoy
7y
0
3
Acausal trade: double decrease
Stuart_Armstrong
5y
0
0
Acausal trade: being unusual
Stuart_Armstrong
5y
0
0
Acausal trade: different utilities, different trades
Stuart_Armstrong
5y
0
0
Acausal trade: Introduction
Stuart_Armstrong
5y
0
0
Acausal trade: full decision algorithms
Stuart_Armstrong
5y
0
0
Acausal trade: universal utility, or selling non-existence insurance too late
Stuart_Armstrong
5y
0