substack = nwprtnarrative.substack.com
Executive Director of the Swift Centre for Applied Forecasting (led projects with U.K. Gov., Google DeepMind, and on AI security and capability risks).
Co-founder of ‘Looking for Growth’ - a political movement for growth in the U.K.
CTO of Praxis - a AI led assessment platform for schools
Former Head of Policy at ControlAI (co-authored ‘A Narrow Path’)
Former Director of Impactful Government Careers
Former Head of Development Policy at HM Treasury
Former Head of Strategy at the Centre for Data Ethics and Innovation
Former Senior Policy Advisor at HM Treasury, leading on the economic and financial response to the war in Ukraine, and the modelling and allocation of the UK's 'Official Development Assistance' budget.
MSc in Cognitive and Decision Sciences from UCL, my dissertation was an experimental study using Bayesian reasoning to improve predictive reasoning and forecasting in U.K. public policy officials and analysts
I am looking for individuals and groups that are interested in improving institutional decision making, whether that's within the typical high-power institutions such as governments/civil services, multilateral bodies, large multinational corporations, or smaller EA organisations that are delivering high-impact work.
I have a broad range of experience, but can probably be of best help on the topics of:
I fear this is missing the main objective though. Maximising taste is solely for the purpose of maximising uptake of alternative meats. There isn’t an intrinsic good in having tasty meat alternatives.
The logic is: tastier meat alternatives —> more people eat meat alternatives —> less animal suffering.
It’s foundational argument is better tasting meat alternatives increase the number of people eating meat alternatives.
There are companies that exist to sell people meat alternatives. So their incentives are aligned. Profit maximising is just an incentive to do that most efficiently, so they’d do it if taste was the most cost effective way - I.e. if for every $1 spent on making meat alternatives taste better it led to $2 of sales, but $1 spent on marketing led to $1.5 of sales, then it’d be better value to spend on making it taste better.
My issue with this RFP is it presumes the market is failing. My question is where is the proof? It being underfunded by public agencies and private R&D suggests to me either massive vested interest (which may be true for public agencies but less clear why Beyond Meat wouldn’t want more customers if tastier meat alternatives was the best way to do that); or it suggests there is a more efficient method being employed by those with the incentives to find it. Unless you think the meat alternative providers don’t want more customers, or are incompetent (in which case why hasn’t a tastier competitor already appeared).
This whole RFP looks to fix a market failure, which I’m not clear exists. It also tries to do that with $10m, which by their on linked numbers is such a tiny fraction of money spent on tasting research. Unfortunately, this RFP has the hallmarks of a fund that would have to be so amazingly well spent to make a difference that the whole thing seems destined to have little to no impact.
I think you are misunderstanding the market incentives here?
There are companies that explicitly exist to produce meat alternatives. Their incentive (whether profit, reducing suffering, empire building) is to produce the best product to have more people buy it (and realistically eat it given that’s the primary purpose of their product). Taste is assumed (given this RFP) to be a key predictor of that, so those alternative meat companies are incentivised to maximise it.
This RFP explicitly says more people eating alternative proteins would be great for reducing animal suffering. So the market incentives and the desired impact are in alignment. Every $ spent by Beyond Meat to improve the taste, and therefore uptake (as this RFP suggests this relationship is sufficiently linked), is great for animal welfare.
Given the above I struggle to see where the misaligned incentives in the market is and why philanthropic funding of $10m is expected to move the dial here.
I think this misunderstands forecasting or mischaracterises decision making.
Your brain absolutely does decide when to make a left-hand-turn at a busy intersection based on a probabilistic estimate. Your brain is just pretty reliable at making said judgments that you assume some binary choice was made. Subconciously you are weighing up the likelihood of various risks based on your senses observing them and concluding that there is a very low (or an appropriately low) probability of it going wrong. The easy way to test this is go to a zip line, one with a drunk operator and one with a sober operator. The zip line may look identically safe but your brain will (hopefully) consider the former more risky - not because the impact of something going wrong is different between the zip lines (both falls would hurt, if not kill you), but because the likelihood of something going wrong is different (as you'd calculate that a drunk operator may not be as cognitively aware of what they are doing). That's a probabilistic assessment.
The difference is, most decisions we deal with in the world don't need us to sit down and do a formal prediction process to ensure good decision making. However, most organisational, and especially those on policy and governance etc., do require it. They are concretely two predictions you are making:
1. What will the world be? (through the lens of what you care about, e.g. will there be an oil crisis?)
2. What influence on the world will my policy have? (e.g. if I send Trump a friendly email will he avoid attacking another petrostate?)
Viewing forecasting as just the probabilistic estimate is missing the entire benefit. Forecasting is the entire process. Stating your view probabilistic just allows you to understand your own and others uncertainty (and to provide a purity of accountability and incentive alignment). It only adds decision fatigue if you have not put in the right processes to interpret the result (such as upfront thresholds for action). If you are following an optimal predictive decision making process, you should be making your assumptions and your weighing up of information explicit. This is how you determine what is relevant, what isn't relevant etc.
Dominic Cummings statement misses that everything he said there IS forecasting. What he's actually saying is "the point estimate from forecasters was not useful - it was the explicit reasoning about the causal chain etc. from forecasters that was useful".
However, benchmarking against accuracy ensures the incentives are correct and that decisions aren't manipulated by elements that decrease the end outcomes efficacy.
If you conclude that it'd be better if decision makers had: 1) the most accurate view of the world; and 2) the most accurate view of how their actions may influence that world towards their objectives. Then I would stand by the statement that it's sad.
So my experience is that identifying/specifying/generating the right questions is at least 50% of the benefit, if not higher. There are lots of reasons organisations struggle with this, from: organisational incentives; incoherent steers and views from senior managers; lack of accountability and ownership; to simply not recognising that they are trying to do a prediction.
This is why forecasting funding that has focused on improving forecasting accuracy is flawed, because it doesn't matter how accurate you are if your question isn't of use to the decision making process.
The problem exists at both those "levels", but the most important one to solve for an organisation is the first one. Issues with resolution criteria etc. decrease accuracy but as long as people's rationale's are explicit you can bridge that gap (i.e. I know why one person was higher and another was lower, it was because they both took the resolution to mean something slightly differently). But if the question/problem you are trying to solve in the first instance is wrong, then the whole thing is a waste of time and energy.
I agree with the premise but we shouldn’t be using philanthropic funds to try to patch over what is a market problem.
The route here should be projects that enable less friction for trade and investment, rather than creating a company that tries to bypass the fundamental issues. Philanthropic funding here should focus on systemic change to have compounded impact.
This obviously assumes Marcus has a sufficient level of experience to justify the claims. Which I think, given other comments, can be adequately challenged.
It would be good to know what metric/threshold/examples would be taken as forecasting delivering adequate impact to justify funding. From examples in this thread alone, we can see senior government decision makers in both the U.K. (including Ministerial teams and critical committees) and US, frontier labs safety teams, and philanthropic funds moving tens of millions of dollars a year) have utilised forecasting (either the process or the outputs) to inform their decisions.
The argument of it only shifting a decision 1-2% is totally fair. But to keep consistent I’d expect the same people who make that argument to also be highly sceptical of the vast majority of research funding.
(Caveat - I read the premises and skimmed the rest)
Yes - AI research is useful and does help highlight specific advancements or potential risks. However, I fear it is being focused on by many because of personal interest in the topic, rather than the best route to reduce catastrophic and existential risks.
For better or worse, advocacy, policy, and communications are the most likely routes to reduce p(doom) - unless you believe alignment is a plausible and concrete thing.
I think the issue is arising from a simple miscommunication.
You seem to be arguing that improving taste has some sort of intrinsic social value in and of itself, that warrants funding. My argument has been, from the start, that if the goal is to maximise uptake of meat alternatives then what is the proof better tasting products is the best method to achieve that and that there is evidence of a market failure there.
Your argument hinges on taste being the value we want here. I reject that as a premise. The value the RFP wants is better uptake of the meat alternatives. And there are big market players that are fundamentally incentivised to solve that (and can raise capital if they prove there will be the returns - I.e. the actual uptake and not just vague “of course if it’s tastier more people will eat it”).
To be as explicit as I can to reply to your argument: your Apple example proves my point above. Your causal chain in that argument is:
More storage -> better insect welfare = win
Apple don’t care about insect welfare (I assume). They care about more users and thus more profit. Thus they aren’t incentivised to solve any part of that causal chain.
This RFPs causal chain is not like that, it’s:
Tastier meat alternatives —> more people eat meat alternatives —> less animal suffering = win
Beyond Meat, even if they don’t care about the end goal (which I assume they probably do), do care about solving the middle part, which is the predictor to the less animal suffering end goal. Given that, if tastier meat was the best way to achieve that, they’d be able to raise capital. If they couldn’t, it’d suggest there wouldn’t be enough uptake from such a move - which means bad value for money and thus either we’ve hit the limit of the number of people who will eat meat alternatives, or it is not an efficient way to increase uptake.
Not to get distracted but to avoid being criticised for not answering your point again: Separately, I also disagree with the foundational research point - in that I think the choice of that is a function of this being philanthropic funds, rather than because it’s solving a market problem such as inability to patent the research or keep it secret. Evidence being: all the food manufacturers who spend money making their food taste better and keep their recipes secret.