Doug,
I found your essay very readable well-thought-out and relevant. Far be it for me to judge how humanity should steer the future (I have made Einstein say as much in my essay) and particularly the very reasonable and logical multiple path search optimisation method you have suggested.
My instincts however are that in social and political action people just go ahead and do what they know best, the tried and true, the easiest, or in a society like Japan, what is least likely to be criticised by friends and neighbors. In other words searching out different possible paths may go against the grain of human nature.
Or indeed of physics, Feynman notwithstanding. In my Streamline Diffraction Theory the streamline is the path integral along which energy flows as light diffracts. And according to my Beautiful Universe theory, nature follows these streamlines to propagate energy, form atoms and all sorts of fields. In all these cases, Nature finds a unique path from A to B. Perhaps humans have evolved to act that way too. Picasso said "I do not seek, I find". Perhaps for humanity to get out of its present difficulty, such confidence, even arrogance and sense of venturing linearly along a a single path (and I do not mean that Bali bridge!) is needed.
Yours is certainly the safer way, though!!
Best wishes
Vladimir