Go Back
Choose this branch
Choose this branch
meritocratic
regular
democratic
hot
top
alive
38 posts
Oracle AI
Self Fulfilling/Refuting Prophecies
Bounties (closed)
Parables & Fables
16 posts
AI Boxing (Containment)
Acausal Trade
Superrationality
Values handshakes
Computer Security & Cryptography
Verification
324
The Parable of Predict-O-Matic
abramdemski
3y
42
67
Proper scoring rules don’t guarantee predicting fixed points
Johannes_Treutlein
4d
2
54
Contest: $1,000 for good questions to ask to an Oracle AI
Stuart_Armstrong
3y
156
49
Results of $1,000 Oracle contest!
Stuart_Armstrong
2y
2
48
Prize for probable problems
paulfchristiano
4y
63
37
Counterfactual Oracles = online supervised learning with random selection of training episodes
Wei_Dai
3y
26
27
Training goals for large language models
Johannes_Treutlein
5mo
5
22
Self-Supervised Learning and AGI Safety
Steven Byrnes
3y
9
17
Analysing: Dangerous messages from future UFAI via Oracles
Stuart_Armstrong
3y
16
17
Oracles, sequence predictors, and self-confirming predictions
Stuart_Armstrong
3y
0
16
Reflective oracles as a solution to the converse Lawvere problem
SamEisenstat
4y
0
15
Cooperative Oracles
Diffractor
4y
9
15
Standard ML Oracles vs Counterfactual ones
Stuart_Armstrong
4y
5
12
Oracles: reject all deals - break superrationality, with superrationality
Stuart_Armstrong
3y
4
139
Decision theory does not imply that we get to have nice things
So8res
2mo
53
43
Cryptographic Boxes for Unfriendly AI
paulfchristiano
12y
162
35
Side-channels: input versus output
davidad
8d
9
34
Superrational Agents Kelly Bet Influence!
abramdemski
1y
5
22
Breaking Oracles: superrationality and acausal trade
Stuart_Armstrong
3y
15
15
Safely and usefully spectating on AIs optimizing over toy worlds
AlexMennen
4y
16
13
Superrationality in arbitrary games
Vanessa Kosoy
7y
0
10
"Fully" acausal trade
Stuart_Armstrong
3y
2
2
Acausal trade: double decrease
Stuart_Armstrong
5y
0
0
Acausal trade: being unusual
Stuart_Armstrong
5y
0
0
Acausal trade: different utilities, different trades
Stuart_Armstrong
5y
0
0
Acausal trade: Introduction
Stuart_Armstrong
5y
0
0
Acausal trade: full decision algorithms
Stuart_Armstrong
5y
0
0
Acausal trade: universal utility, or selling non-existence insurance too late
Stuart_Armstrong
5y
0