There's an excellent critique of that paper on LW: https://www.lesswrong.com/posts/yWCszqSCzoWTZCacN/report-likelihood-ratios
The conclusion is that exponentials look better for longer-run trends, if you do fair comparisons. And that linear being a better fit than exponentials in recent data is more about the error-model than the growth-model, so it shouldn't be a big update against exponential growth.
I think TFP should have a constant upper bound due to physical limits, but maybe we're unlikely to get anywhere near it in practice; I wouldn't know.
Separately, capital and labour growth are limited by exploring and exploiting space at a cubic rate, bounded by the speed of light in all directions.
So, growth is bounded above by a cubic function, assuming our current understanding of physics.
Good point! Though I think it shouldn't be difficult to figure out a lower upper bound, maybe an economist is working on that right now, depending on how actively researched this domain is.