The fact that people decide to work in industry / government isn’t an indicator that there’s a surplus of candidates wanting to do academic research. The fact that we’ve had to import more and more talent in STEM fields during the last few decades indicates that there aren’t enough US citizens wanting to do academic research.
Sure, but you seem to imply that the long process of grad school and post-doc with poor pay is because of a shortage of academic positions.
That’s not true.
Even those whose first priority is to go to industry/government research jobs still have to go through that long process. That “long process” does not result from a shortage of academic positions. That “long process” results from the training required to do high end research. Just like it still requires about 6 years of post-undergrad training to do high-end medical treatments.
I was in a PhD physics program. I was an “ABD” when I quit. The primary reason was that I got a close look at the “chase funding” and “publish or perish” side of things, and decided that wasn’t for me. So I wimped-out with the “ABD”, and took an industry job. It took a few years before I found my niche -failure analysis-, but after that I was trying to solve puzzles. I would have liked more to be pushing the frontiers of knowledge, but I realized that lead scientists do a lot more funding-chasing than science. I would have HATED that.
I knew guys in the grad dorm getting business degrees, and all they could talk about was how much they could make later. The money was attractive, but the “work” [cough] was entirely unappealing. As you said, shuffling money around without actually producing anything, or discovering anything. If there’s a hell, that would be included.