Discussion about this post

User's avatar
Niko Kovacevic's avatar

Appreciate your insights, Michael. I’m curious what you think of a somewhat related Straussian/Socratic view of LLMs.

According to Strauss, “Socrates started not from what is first in itself or first by nature but from what is first for us, from what comes to sight first, from the phenomena. But the being of things, their What, comes first to sight, not in what we see of them, but in what is said about them or in opinions about them.” (NRH 4, pp. 124)

In that sense, if we stipulate that both training data and RLHF are akin to “common opinion” then “what comes first to sight” for human beings is one and the same with the inputs to LLM intelligence. Then again, that is a big “if” to stipulate.

Do you have thoughts on this idea?

No posts

Ready for more?