

I think a major influence was “Wisdom of the Crowds” which was discussed in the SF / Berkeley tech community quite a bit back then. At some point that got combined with gambling. There’s an old reference here dated 2007: https://www.overcomingbias.com/p/how_and_when_tohtml




Half the job posts I see on linkedin are from snorkel, handshake and mercor etc to train llms for $50-90/hr. So I think there’s been quite a bit of new training data created as those companies scaled up.
So everyone is paying openai to pay mercor to pay contractors to write code and then regurgitate it, rather than just paying for what they want directly.
idk. I’m just skeptical that there was actually no human in the loop and that the gains were from unit tests / synthetic TDD.