Engineering leader working to find ways to deploy AI responsibly.
For anyone interested I've posted a follow up to this post investigating these ideas and developing a black box procedure for improving our understanding of LLM accuracy: A Black-Box Procedure for LLM Confidence in Critical Applications — LessWrong
How big a deal is access to compute? In order to perform research on frontier models, are we to the point where only the companies with the largest compute and training budgets can play?
For anyone interested I've posted a follow up to this post investigating these ideas and developing a black box procedure for improving our understanding of LLM accuracy: A Black-Box Procedure for LLM Confidence in Critical Applications — LessWrong