Hide table of contents

Introduction

When I first read about effective altruism, it wasn’t long until I came across the importance-neglectedness-tractability (INT) framework. Almost immediately upon reading a description of the framework I stopped and excitedly said aloud “wait, this is just the stock issues! … Sort of…!”

For years, I had practically been preaching the stock issues framework—the poorly named, varyingly conceived, and occasionally misapplied decision-evaluation framework which nonetheless rests at the heart of competitive policy debate in many high school leagues. It just seemed like such a simple and effective way to improve decision making, yet I had never seen even a generic/alternatively-named version of it outside of debaterland. Then, lo and behold, I find the 80,000 Hours description of the INT framework. (The framework turned out to be just one of many EA-related concepts that I had loosely articulated/supported even prior to actually learning about EA)

Yet, I soon came to see that they are distinct in some key ways, even if they are conceptually similar. Furthermore, I saw that the stock issues framework seems to avoid some of the problems that people have pointed out with the INT framework (e.g., assumptions regarding diminishing marginal returns).

I will explain what the stock issues are in the next section, but I wanted to note up front that I still have not come across even a generic/alternatively-named version of the stock issues framework, even as I’ve looked through EA forum/concepts posts where I thought I might find some mention of a decision-centered framework[ftn 1] like the stock issues, only to instead find references to things like typical cost-benefit analysis or the INT framework. I had considered but delayed writing a comment/post on this for some time, but then I saw this post and didn’t see any mention of this concept,[2] so I felt compelled to finally write this post.

Brief Outline

In this post, I hope to:

  1. Introduce and explain a framework for evaluating decisions which at least seems (based on some mild-moderate research) to be surprisingly unarticulated/unknown in the EA community;
  2. Partially compare/contrast it with the INT framework;
  3. Solicit some feedback/thoughts on the framework, especially regarding its applicability to EA, and also ask some more general questions (e.g., “have you seen this framework or something similar”)

I will say up front that I may be imprecise at times in my definitions (among other things), since it’s a lot to cover and I don’t want to write something so long [3] and nuanced in an introduction article (for both your sake and mine); if needed, I can clarify things in response to questions.

What is the stock issues framework?

Because people are often initially confused, I’ll first note that it has nothing to do with “stocks” as in the stock market; the “stock” part of the name just refers to “key/central” issues. Second, even though in my experience most debaters refer to “it” as “a” universal concept (i.e., “the” stock issues), there are lots of minor variations in how people conceive of the framework (e.g., how they define the issues and which issues they include). My interpretation, though, is notably unique—in large part since I’ve tried to adapt the framework for use outside of just competitive policy debate rounds. Additionally, as is the case with the INT framework, there are “informal” (heuristic) and “formal” (more-rigorously defined) conceptions of the framework. However, for now I will typically focus on defining it in the more-formal sense, especially since the two aren’t radically different. [4]

With those points out of the way, I can finally outline the framework, then respond to commentary/objections as needed. (If you want a longer explanation, you can read these two articles.)

In short, the framework breaks down the analysis of individual costs and benefits (i.e., each advantage and disadvantage) of a decision into four smaller, more-manageable claims/concepts which are linked and collectively exhaustive—and, in the formal conception, conceptually distinct. Thus, it is used to scrutinize or measure the expected/claimed advantages and disadvantages of a decision.

As illustrated by the diagrams later on, these four issues roughly map onto a 2x2 matrix along lines similar to “before/after” and “cause/effect” (but not exactly those terms, as clarified in the diagrams). Before I explain each one individually, I think it helps to briefly outline what they generically look like together when explaining benefits/advantages:

  1. Inherency/Gap: There is a particular aspect of the status quo (or its future)... (somewhat similar to INT’s neglectedness mixed with parts of importance)
  2. Significance: Which is bad/nonoptimal… (somewhat similar to “importance”)
  3. Feasibility/Implementation: But a course of action could/would be taken… (related to tractability)
  4. Solvency [5]: Which would fix/improve that aspect of the status quo. (related to tractability)

(For anyone who actually is familiar with traditional stock issue theory in policy debate and is wondering where topicality is, the short answer is that I don’t include it since it is a “pseudo/heuristic issue” which is just highly useful given the rules of policy debate but logically redundant—as I explain in more detail here.)

It’s rather unfortunate that the first stock issue is the worst-named and most confusing, but basically it just makes the purely descriptive claims regarding what the current situation is and/or what the future will be like without the decision in question. It’s helpful to consider it in conjunction/contrast with significance, which is where one attaches a normative (“good/bad”) dimension to the inherency claims.[6] Together, these two points make up something similar to the “before” part of a loose “before/after” analysis.

The third stock issue, feasibility/implementation, essentially relates to the question “to what extent can/will the decision actually be implemented?” Again, it helps to consider this in conjunction/contrast with the next issue, solvency. Solvency basically refers to the claims regarding the effects of the decision/plan, supposing it is implemented in a certain way or to a certain extent.

The four points interact to create something of a multiplication equation (somewhat similar to the INT framework) which can be used when evaluating the individual costs and benefits in a cost-benefit analysis. Policy debaters generally simplify the framework and just say things like “an advantage’s weight is the degree to which an issue is inherent (e.g., the amount of pollution that exists) times the degree to which it is significant (e.g., the severity of that pollution existing) times the degree to which the plan solves it (e.g., how much pollution is reduced by the plan).” That’s somewhat imprecise/informal; it is probably better described at least as a product of functions if not a singular nest of functions. However, for now I’ll just leave it at that, and clarify/formalize later. One of the key reasons for highlighting its multiplicative nature, though, is the interdependence of the issues: if a decision seeks to fix a definitely-existent and normatively serious problem, but has either 0% feasibility or 0% solvency, it’s basically irrelevant.

At one point, I decided to try to illustrate these concepts visually by creating a diagram that essentially creates a loose 2x2 matrix (and has questions associated with each stock issue); I personally acknowledge these diagrams might be imprecise and a bit clunky (especially some of the row/column labels), but the diagrams are mainly just meant to illustrate the framework’s underlying reasoning (i.e., that it just slices up the analysis of an advantage into smaller parts—along lines reminiscent of “before/after” and “cause/effect”). Here is the diagram for advantages:

The same kind of analysis can be done for disadvantages, as illustrated by the following diagram. Note: although the names of the issues are different (due to policy debate jargon, tradition, etc.), the concepts being described are basically all the same except towards a negative end.

To apply it all in a relatively simple example, let’s suppose the decision in question is whether your organization should allocate $10,000 to a charity dealing with some health intervention. The stock issues framework holds that for any individual advantage that you claim stems from that decision, it logically must address the four criteria:

  • Inherency: What is the extent/nature of the situation or issue in question, descriptively speaking? How many people actually have or are at risk of having the condition? Is there any money already allocated to deal with this issue? (Note, though, that this does not in itself determine “diminishing marginal returns.” To evaluate diminishing marginal returns requires combining this factual/descriptive understanding of the status quo with the analysis in solvency.)
  • Significance: Does the current situation actually matter, normatively speaking? How much do the people in question suffer? Is this relevant under the/a valid moral framework (or “the moral framework we have justified and are operating under”)?
  • Feasibility/implementation: Will this plan actually get implemented (as supposed)? Do we actually have $10,000 that we can allocate? Can we do it in the proposed timeframe? Will this require some funding or personnel which is not allocated?
  • Solvency: Supposing we do implement the decision (or, for each possible degree of implementation), to what extent will this decision solve the problem described by inherency and significance?

Ultimately, like I said up front, it’s hard to strike a balance between preemptive clarifications/nuance and readability/writability (especially since I’m so familiar with it that I sometimes struggle to know where I might be losing people); given that I can address questions in comments and I’ve covered it with more examples elsewhere, I’ll mostly leave it at that for now.

Comparing/Contrasting With the INT Framework

I imagine that some of the comparisons to the INT framework might already be clear by this point, but I’ll note a few key points on their similarities and differences:

  • Both frameworks try to break larger, more-complex questions into multiple smaller, more-manageable questions.
  • The two frameworks both can have varying levels of formality in usage: the informal/less-restrictive approaches can serve as heuristics that spark questions (among other benefits); the formal approaches try to accurately identify the logic underpinning the analysis.
  • The frameworks’ “issues” (individual points) have some loose similarities, such as neglectedness vs. inherency, tractability vs. solvency. However:
  • Crucially, the stock issues and the INT framework have different “units of analysis”: the INT framework evaluates problem areas whereas the stock issues analyze decisions.
  • Mainly as a result of this, the frameworks’ “issues” are meaningfully distinct. For example, the stock issues framework absorbs and splits some of the relevant aspects of neglectedness into inherency and solvency, while leaving out some of neglectedness’ problematic assumptions regarding diminishing marginal returns.

(A Future Update/Post: Why I Recommend/Use the Stock Issues Framework)

This is quite a can of worms to tackle, and this post has already gotten a bit long. In the past, I have made explicit arguments for why I think it is helpful in a variety of settings, and thus I can definitely try to give a defense of this. I think it would be more helpful/efficient, though, to get a sense of what people are or aren’t skeptical/confused about before trying to cast such a wide net of preemptive argumentation.

That being said, I will admit that I am less confident in the claim “The stock issues framework is very useful in a setting such as this (EA)” vs. claims like “The stock issues are collectively exhaustive” and “It is useful in analyzing policies,” but given my views on its effectiveness in other areas, I do expect it would likely at least be helpful to have as a tool in your back pocket, if nothing else.

Conclusion

Hopefully I have explained it decently enough—at least to the point that you can get the general idea and ask questions anywhere you are confused. Ultimately, through policy debate I have seen how it can be an effective framework for decision-making, so I figured that it could be helpful in certain aspects of EA decision-making, but have been surprised to see how little attention/awareness it seems to have in comparison with other frameworks.

I do recognize that the INT framework is meant to help guide thinking about general cause prioritization rather than individual decisions by evaluating problems’ characteristics (even if the goal is to help decisions such as “which cause should I prioritize”). However, when it comes to frameworks for decisions, I haven’t found much other than cost-benefit analysis as a formal/exhaustive foundation on one end with informal/non-exhaustive “pieces” or heuristics (e.g., urgency, hingeyness, the informal INT framework) on the other. In contrast, I would argue that the stock issues framework is just as exhaustive as basic cost-benefit analysis, yet also provides some “pieces” and heuristics that help guide/test your analysis. (As well as providing other benefits which I will discuss at a later time.)

Questions

  • (A preliminary/implicit question: is my explanation clear, or are there parts I still need to clarify?)
  • Is there anything in the EA community already like this—primarily, something which analyzes decisions (rather than problems) and breaks down the evaluative analysis in smaller but collectively exhaustive pieces?
  • Has anyone seen anything else like this outside of EA or debate?
  • I’d love to just get your general opinions on the framework, primarily in terms of “accuracy/coherency” and/or “usefulness.”
  • Lastly, any recommendations on changes/tweaks are definitely welcome!

---------

Footnotes

1. This source in particular (https://mdickens.me/2016/06/10/evaluation_frameworks_(or-_when_scale-neglectedness-tractability_doesn't_apply)/) does try to provide an alternative framework for focusing on decisions rather than problems, but they take an approach that I think might work better when used within the stock issues framework (e.g., finding evidence through the lens of / to fulfill each of the stock issues), rather than vice versa or just plainly not using the stock issues’ framework’s reasoning.

2. In retrospect, especially having read more about some of the frameworks and their purposes, I suppose that this may not be a full alternative to the INT framework, but I’ve since figured it is related enough to warrant some response.

3. Upon finishing this, I realize I might have failed this goal.

4. One of the most notable differences between the formal and informal frameworks is the division between inherency and significance: if they even bother making the distinction explicit/clear, many debaters will tend to treat significance as including “descriptive causal” claims in addition to “end normative” claims. For example, they may say “The inherency is that we currently have a tariff in place. The significance is that the tariff causes economic harm (which is just obviously bad).”

5. I and many other people including coaches have pointed out that this is not what the word “solvency” means in common/non-debater usage, but it’s stuck very well in leagues (especially among high schoolers who have never used the actual meaning of the word), so it’s what people say.

6. When this is taken very literally, it seems that significance could start to ontologically shrivel up in relation to inherency, given that someone might be able to technically say “You say the status quo leads to economic harm, but is economic harm inherently ‘bad’? Causes people to die, you say? But is that inherently bad? Suffering? What even is suffering but chemicals/neurons producing a factual state in someone’s mind?” This is part of the reason why I (and other debaters, perhaps unwittingly) tend to use significance in the more informal sense, as mentioned in a previous footnote.

Comments


No comments on this post yet.
Be the first to respond.
Curated and popular this week
Garrison
 ·  · 7m read
 · 
This is the full text of a post from "The Obsolete Newsletter," a Substack that I write about the intersection of capitalism, geopolitics, and artificial intelligence. I’m a freelance journalist and the author of a forthcoming book called Obsolete: Power, Profit, and the Race to build Machine Superintelligence. Consider subscribing to stay up to date with my work. Wow. The Wall Street Journal just reported that, "a consortium of investors led by Elon Musk is offering $97.4 billion to buy the nonprofit that controls OpenAI." Technically, they can't actually do that, so I'm going to assume that Musk is trying to buy all of the nonprofit's assets, which include governing control over OpenAI's for-profit, as well as all the profits above the company's profit caps. OpenAI CEO Sam Altman already tweeted, "no thank you but we will buy twitter for $9.74 billion if you want." (Musk, for his part, replied with just the word: "Swindler.") Even if Altman were willing, it's not clear if this bid could even go through. It can probably best be understood as an attempt to throw a wrench in OpenAI's ongoing plan to restructure fully into a for-profit company. To complete the transition, OpenAI needs to compensate its nonprofit for the fair market value of what it is giving up. In October, The Information reported that OpenAI was planning to give the nonprofit at least 25 percent of the new company, at the time, worth $37.5 billion. But in late January, the Financial Times reported that the nonprofit might only receive around $30 billion, "but a final price is yet to be determined." That's still a lot of money, but many experts I've spoken with think it drastically undervalues what the nonprofit is giving up. Musk has sued to block OpenAI's conversion, arguing that he would be irreparably harmed if it went through. But while Musk's suit seems unlikely to succeed, his latest gambit might significantly drive up the price OpenAI has to pay. (My guess is that Altman will still ma
 ·  · 5m read
 · 
When we built a calculator to help meat-eaters offset the animal welfare impact of their diet through donations (like carbon offsets), we didn't expect it to become one of our most effective tools for engaging new donors. In this post we explain how it works, why it seems particularly promising for increasing support for farmed animal charities, and what you can do to support this work if you think it’s worthwhile. In the comments I’ll also share our answers to some frequently asked questions and concerns some people have when thinking about the idea of an ‘animal welfare offset’. Background FarmKind is a donation platform whose mission is to support the animal movement by raising funds from the general public for some of the most effective charities working to fix factory farming. When we built our platform, we directionally estimated how much a donation to each of our recommended charities helps animals, to show users.  This also made it possible for us to calculate how much someone would need to donate to do as much good for farmed animals as their diet harms them – like carbon offsetting, but for animal welfare. So we built it. What we didn’t expect was how much something we built as a side project would capture peoples’ imaginations!  What it is and what it isn’t What it is:  * An engaging tool for bringing to life the idea that there are still ways to help farmed animals even if you’re unable/unwilling to go vegetarian/vegan. * A way to help people get a rough sense of how much they might want to give to do an amount of good that’s commensurate with the harm to farmed animals caused by their diet What it isn’t:  * A perfectly accurate crystal ball to determine how much a given individual would need to donate to exactly offset their diet. See the caveats here to understand why you shouldn’t take this (or any other charity impact estimate) literally. All models are wrong but some are useful. * A flashy piece of software (yet!). It was built as
 ·  · 16m read
 · 
Over the years, I have learned many things that are rarely taught about doing cost-benefit or welfare analysis. Here are a few things that I often end up repeating when I mentor individuals or teams working on these kinds of projects: A Point Estimate is Always Wrong For any purpose other than an example calculation, never use a point estimate. Always do all math in terms of confidence intervals. All inputs should be ranges or probability distributions, and all outputs should be presented as confidence intervals. Do not start with a point estimate and add the uncertainty later. From day one, do everything in ranges. Think in terms of foggy clouds of uncertainty. Imagine yourself shrinking the range of uncertainty as you gather more data. This Google Sheets Template allows you to easily set up Monte Carlo estimations that turn probabilistic inputs into confidence-interval outputs. Use Google Sheets I have experience programming in half a dozen languages, including R. Sometimes they are useful or necessary for certain kinds of data analysis. But I have learned that for almost all cost-benefit analyses, it is best to use Google Sheets, for several reasons. The main one is transparency. A cost-benefit or welfare analysis is a public-facing document, not an academic one. You should not use esoteric tools unless absolutely necessary. Anyone in your society with basic literacy and numeracy should be able to read over and double-check your work. When you are done and ready to publish, you make your Sheet visible to everyone, and add a link to it in your report. Then anyone can see what you did, and effortlessly copy your code to refine and extend it, or just play around with different priors and assumptions. This transparency also helps improve results and correct mistakes as you are doing the work. The more people review your math, the better it will be. The number of people who are willing and able to look over a spreadsheet is orders of magnitude higher than the
Relevant opportunities