A number of policy tools such as regulations, liability regimes or export controls - aimed at tackling AI risks - have already been explored, and mostly appear as promising and worth further iterations.
But AFAIK no one has so far come up with a concrete proposal to use tax policy tools to internalize AI risks. I wonder why, considering that policies, such as tobacco taxes, R&D tax credits, and 401(k), have been mostly effective. Tax policy also seems to be underutilized and neglected, given we already possess sophisticated institutions like tax agencies or tax policy research networks.
Safety measures spending of AI Companies seems to be relatively low, and we can expect that if competition intensifies, these expenses will be even lower.
So I've started to consider more seriously the idea of tax incentives - basically we can provide a tax credit or deduction for expenditures on AI safety measures like alignment research, cybersecurity or oversight mechanisms etc. which effectively could lower their cost. To illustrate: AI Company incurs safety researcher salary as a cost and then 50% of that cost can be additionally deducted from the tax base.
My guess was that such tool could influence the ratio of safety-to-capability spending. If implemented properly it could help mitigate competitive pressures affecting frontier AI labs by incentivising them to increase spending on AI safety measures.
Like any market intervention, we can justify such incentives if they correct market inefficiencies or generate positive externalities. In this case, lowering the cost of security measures helps internalize risk.
However there are many problems on path to design such tool effectively:
The crucial problem is that financial benefit from tax credit can't match the expected value of increasing capabilities. Underlying incentives for capability breakthroughs are potentially orders of magnitude larger. So simply AI labs wouldn't bother and keep the same level while getting extra money from incentives which is an obvious backlash.
However, if some AI Company plans to increase safety expenses due to their real concerns about risks or external pressures (boards, public etc.), perhaps they would be more willing to do it.
Also risk of keeping the same safety expenses level could be overcome by requiring a specific threshold of expenditures to benefit from the incentive.
The focus here is on inputs (spending) instead of outcomes (actual safety).
Implementing it would be pain in the ass, requiring creating specialised departments within IRS or delegating most of the work to NIST.
Defining the scope of qualified expenditures - it could be hard to separate safety from capabilities research cost. Keeping an eye on this later can be a considerable administrative cost.
Expected expenses could be incurred regardless of the public funding received if we just impose a strict requirement.
There could be a problem of safety washing - AI labs creating an impression and signalling that appropriate safety measures are implemented and benefiting from incentives while not decreasing the risk effectively.
I don't know much about US tax system but I guess it could overlap with existing R&D tax incentives. However, existing incentives are unlikely to reduce the risk. if they are used for both safety and capabilities research then they
Currently most AI labs are in loss position so they can't effectively benefit from such incentives unless some special feature is put in place, like refundable tax credits or the option to claim such relief/credit as soon as they make a taxable profit.
Perhaps direct government financing would be more effective. Or existing ideas (such as those mentioned earlier) would be more effective and we don't have enough room for weaker solutions.
Maybe money isn't a problem here as AI labs are more talent constrained. If the main bottleneck for effective safety work is a talented researcher, then making safety spending cheaper via tax credits might not significantly increase the amount of high-quality safety work done.
Is there something crucial that I am missing? Is it worth investigating further? So far it has more problems than the potential benefits so I don't think it's promising, but I'd love to hear your thoughts on it.
That's right, I imagine that for those with a technical background, reading legislation may not be intuitive. However, one can consider looking for simplified explanations or supplementary materials. These can provide a foundation for understanding the key principles, which are enough to understand their underlying assumptions and, consequently, allow for their evaluation.
Wow! Amazing job! Thank you, I can't wait to find more time and dive into some of the resources you mentioned. I will certainly refer more to your post after that!
(This is not legal/tax advice, also I'm not familiar with U.S tax law)
In case of fraud (of course hope it's not), It could be helpful for people who invested in FTX, to check if any tax deduction/relief could apply in his case (some brief info you can get here).
However, in some cases, there could be no way to compensate for losses because of a lack of capital gains.
I'm also curious whether there is any chance for EA orgs funded by FTX, to make any deduction or apply a relief for financial support withheld.
It's just a tiny prompt for further exploration. I hope any U.S tax lawyer can explain it.
If I am misleading anyone, please let me know (I will then delete/adjust the comment).
Love this post, It's so engaging! I hope that you will get more attention and your idea become real. I'm wondering which types of businesses could most easily convert/insert tofu production. The meat industry could have some reservations about expanding production to include tofu, perhaps R&D into cheaper methods of tofu production would be useful in this regard.
- It seems that the cost of outsourced services is sometimes unduly inflated. Take, for example, legal services. Besides drafting contracts, the lawyer also informs the client about the risks associated with a particular activity and how to mitigate them. Unfortunately, this area is prone to lawyer abuse in the form of artificially generating problems which translates into higher costs. For this reason, I guess small organisations tend to leave this kind of work to administrative or management personnel, and larger organisations tend to hire in-house lawyers.
- Second thing is that generalists and junior staff sometimes tend to switch within an organisation into other positions, so for EA orgs, it could be an opportunity for spotting talent who has a good fit for working in, as you said, core competencies, which probably would not be possible otherwise.
I'm researching how safety frameworks of frontier labs (Anthropic RSP, OpenAI Preparedness Framework, DeepMind FSF) have changed between versions.
Before I finish the analysis, I'm collecting predictions to compare with actual findings later. 5 quick questions. Questions
Disclaimer: please take it with a grain of salt, questions drafted quickly with AI help, treating this as a casual experiment, not rigorous research.
Thanks if you have a moment
Tax incentives for AI safety - rough thoughts
A number of policy tools such as regulations, liability regimes or export controls - aimed at tackling AI risks - have already been explored, and mostly appear as promising and worth further iterations.
But AFAIK no one has so far come up with a concrete proposal to use tax policy tools to internalize AI risks. I wonder why, considering that policies, such as tobacco taxes, R&D tax credits, and 401(k), have been mostly effective. Tax policy also seems to be underutilized and neglected, given we already possess sophisticated institutions like tax agencies or tax policy research networks.
Safety measures spending of AI Companies seems to be relatively low, and we can expect that if competition intensifies, these expenses will be even lower.
So I've started to consider more seriously the idea of tax incentives - basically we can provide a tax credit or deduction for expenditures on AI safety measures like alignment research, cybersecurity or oversight mechanisms etc. which effectively could lower their cost. To illustrate: AI Company incurs safety researcher salary as a cost and then 50% of that cost can be additionally deducted from the tax base.
My guess was that such tool could influence the ratio of safety-to-capability spending. If implemented properly it could help mitigate competitive pressures affecting frontier AI labs by incentivising them to increase spending on AI safety measures.
Like any market intervention, we can justify such incentives if they correct market inefficiencies or generate positive externalities. In this case, lowering the cost of security measures helps internalize risk.
However there are many problems on path to design such tool effectively:
Is there something crucial that I am missing? Is it worth investigating further? So far it has more problems than the potential benefits so I don't think it's promising, but I'd love to hear your thoughts on it.
That's right, I imagine that for those with a technical background, reading legislation may not be intuitive. However, one can consider looking for simplified explanations or supplementary materials. These can provide a foundation for understanding the key principles, which are enough to understand their underlying assumptions and, consequently, allow for their evaluation.
What is your greatest achievement?
Many job offers, competitions and other application processes require you to state your greatest achievement.
I'm always having a problem with this one due to not being goal-oriented. Besides, I do not see any of my results as achievements.
What are some examples of achievements (or even categories of achievements) for an undergraduate or a person starting a career?
Wow! Amazing job! Thank you, I can't wait to find more time and dive into some of the resources you mentioned. I will certainly refer more to your post after that!
(This is not legal/tax advice, also I'm not familiar with U.S tax law)
In case of fraud (of course hope it's not), It could be helpful for people who invested in FTX, to check if any tax deduction/relief could apply in his case (some brief info you can get here).
However, in some cases, there could be no way to compensate for losses because of a lack of capital gains.
I'm also curious whether there is any chance for EA orgs funded by FTX, to make any deduction or apply a relief for financial support withheld.
It's just a tiny prompt for further exploration. I hope any U.S tax lawyer can explain it.
If I am misleading anyone, please let me know (I will then delete/adjust the comment).
Love this post, It's so engaging! I hope that you will get more attention and your idea become real. I'm wondering which types of businesses could most easily convert/insert tofu production. The meat industry could have some reservations about expanding production to include tofu, perhaps R&D into cheaper methods of tofu production would be useful in this regard.
Very interesting, I like this idea!
There are only two things that concern me:
- It seems that the cost of outsourced services is sometimes unduly inflated. Take, for example, legal services. Besides drafting contracts, the lawyer also informs the client about the risks associated with a particular activity and how to mitigate them. Unfortunately, this area is prone to lawyer abuse in the form of artificially generating problems which translates into higher costs. For this reason, I guess small organisations tend to leave this kind of work to administrative or management personnel, and larger organisations tend to hire in-house lawyers.
- Second thing is that generalists and junior staff sometimes tend to switch within an organisation into other positions, so for EA orgs, it could be an opportunity for spotting talent who has a good fit for working in, as you said, core competencies, which probably would not be possible otherwise.