If you have a desk at Anthropic, and you are analyzing the same data as Anthropic employees, and you have the same skillset as Anthropic employees, and you are paid 1/5th what Anthropic employees are paid, then you will eventually apply for a job at Anthropic. Third-party, independent evaluators will either become a revolving door to the industry, or else they’ll be utterly outmatched.
Who Should Pace the Frontier? Not Dario Amodeitechpolicy.pressWe should take Dario Amodei’s writing just seriously enough to stop entrusting him with so much power, writes Dave Karpf.