Subagents and impact measures

If I were a well-intentioned AI...


"Go west, young man!" - Preferences in (imperfect) maps

Sorry, had a few terrible few days, and missed your message. How about Friday, 12pm UK time?

"Go west, young man!" - Preferences in (imperfect) maps

Stuart, I'm writing a review of all the work done on corrigibility. Would you mind if I asked you some questions on your contributions?

No prob. Email or Zoom/Hangouts/Skype?

The ground of optimization

Very good. A lot of potential there, I feel.

"Go west, young man!" - Preferences in (imperfect) maps

The information to distinguish between these interpretations is not within the request to travel west.

Yes, but I'd argue that most of moral preferences are similarly underdefined when the various interpretations behind them come apart (eg purity).

mAIry's room: AI reasoning to solve philosophical problems

There are computer programs that can print their own code:

There are also programs which can print their own code and add something to it. Isn't that a way in which the program fully knows itself?

The Goldbach conjecture is probably correct; so was Fermat's last theorem

Wiles proved the presence of a very rigid structure - not the absence - and the presence of this structure implied FLT via the work of other mathematicians.

If you say that "Wiles proved the Taniyama–Shimura conjecture" (for semistable elliptic curves), then I agree: he's proved a very important structural result in mathematics.

If you say he proved Fermat's last theorem, then I'd say he's proved an important-but-probable lack of structure in mathematics.

So yeah, he proved the existence of structure in one area, and (hence) the absence of structure in another area.

And "to prove Fermat's last theorem, you have to go via proving the Taniyama–Shimura conjecture", is, to my mind, strong evidence for "proving lack of structure is hard".

The Goldbach conjecture is probably correct; so was Fermat's last theorem

You can see this as sampling times sorta-independently, or as sampling times with less independence (ie most sums are sampled twice).

Either view works, and as you said, it doesn't change the outcome.

The Goldbach conjecture is probably correct; so was Fermat's last theorem

Yes, I got that result too. The problem is that the prime number theorem isn't a very good approximation for small numbers. So we'd need a slightly more sophisticated model that has more low numbers.

I suspect that moving from "sampling with replacement" to "sampling without replacement" might be enough for low numbers, though.

Load More