Babel and Beyond: Can humanity unite? by Mark Avrum Gubrud

Not at all, it only means the rating system itself is worth precisely "4.2". Seriously, it's flawed. But I expect your score to improve, as I think many people (like myself) hold off voting till near the end. If it doesn't improve (and dramatically), then I hope someone will explain why it deserves such a middling score, because I can't. - Mike

Dear Mark,

You warmed us on the AI weapon system early on. The SAI system that is also control our war machine is putting the fate of humanity in the hands of unknown species that we would create. I agree that if we must debate this SAI extensively. No doubt SAI is both good and bad. However the self-aware and self autonomous being that control the weapon of mass destruction should be banned. If we are not careful, this SAI would take control eventually if we are careless. I am not against Self-aware AI, but we should not give it the logic to kill humans whatever good cause it might be. As you wrote : "The time to stop is now, when nations are beginning to contemplate the use of autonomous weapon systems and are debating whether to ban or restrict them (Gubrud 2014). Human control, responsibility, dignity and sovereignty are clear principles, and autonomous machine decision in the use of violent force is a clear red line. All humanity can recognize, and all nations can agree to respect these principles." I endorse this view. I rate your essay a ten(10).

Good Luck!

Best wishes,

Leo KoGuan

Marc,

Watson was one of the three contestants that only answered the questions. Watson had billions of pieces of information packed into its electronic memory banks, any one of which it could retrieve almost immediately. If Watson had had to ask the questions, it would have been a different matter. Watson would have only been able to ask a question that had already been asked on the show. Watson would have been unable to ask trick questions. Jennings and the other guy would have stood a better chance of answering the straight forward questions Watson was forced to ask.

Joe

Dear Leo KoGuan,

Thank you so much for your kind comments. I understand that you are a very successful businessman, and your own essay shows that you are a very broad and humane thinker.

I am very encouraged by your expression of support for the goal of banning machine control of the instruments of conflict and violence. There is a lot of resistance to thinking about this in the context of self-aware and willful artificial intelligence, which people scorn as "science fiction" even though it is increasingly well grounded in science fact.

Instead, most of the opposition to killer robots is framed in terms of their stupidity and consequent inability to fulfill the requirements of international law. This is certainly valid for the time being, but as time progresses people are less inclined to be certain that it will always be true. Hence there is an urgent need to address the issue also from the perspective that you express.

I like to say: Stupid robots are dangerous, and smart ones even more dangerous. Probably the most dangerous of all are the ones that are right in between stupid and smart.

A lot of people worry about what a superintelligent machine might do. I like to say, if you are worried about that, let's not start by arming them!

Thank you so much for the high rating. Since you may be able to help with the effort to stop killer robots, I hope that we will be in touch.

best reasonable wishes,

Mark

Hi Mark,

You've got me confused with the esteemed University of Oklahoma zoologist Thomas S. Ray (also known more commonly as Tom Ray), inventor of the TIERRA artificial life program. I have high regard for Dr. Ray's research -- and I sign my work T.H. Ray to try and avoid the confusion, though many do it anyway. :-) Our fields are pretty closely related, on the level of abstract modeling.

Best,

Tom

Mark,

Thank you for a very interesting essay.

I think you raise a lot of important points:

1. That if humanity is made of many communities with conflicting interests, it becomes very difficult to identify global future goals that humanity should steer towards.

2. That a lot of the evil in the world could arise through the pursuit of good, instead of purposeful evil action.

3. That, in any debate, reaching certainty and "closure" is a sign that you have become a "partisan", which is counterproductive.

4. That, for a debate to be fruitful, the receiver of the message must do some work, must take the time to receive the information and to understand it... which is, unfortunately, not often the case.

5. That ordinary citizens sometimes argue passionately about scientific issues (GMOs, energy policy), but that they often preselect the sources of their information through their personal motives and prejudices (even when they are not aware of the fact).

To address, among other things, the "problems" no. 4 and 5, I proposed in my essay that we try to identify collectively the most important basic knowledge that is useful to have a debate about the future, and that we refocus education (formal and lifelong) to ensure that the greatest number of citizens are made to participate in a worldwide "conversation" about the future: I call this endeavour the "Futurocentric Education Initiative".

The Futurocentric Education Initiative is a possible way to address the "Babel Problem": we could call it an "Augmented Intelligence" approach, which could complement the "Artificial Intelligence" approach that you tentatively suggest. While we wait for truly general artificial intelligence to appear (some people believe it is imminent, some think that it can never happen), maybe we can pool our human natural intelligence resources, augmented and coordinated through the Internet, to steer education, in order to eventually steer the future!

Your essay is one of the most on-topic that I have read, and I hope that it does well in the competition. Several essays in this contest emphasize that better communication and education is essential if we want humanity to successfully steer the future, and I hope your essay makes it to the finals so this point of view can be represented. (I have nothing against the unification of quantum mechanics and general relativity, but I think that this year's question deserves other approaches than just "let's unify QM and GR so we can save the world"!)

Marc

Dear Mark,

Your Babel and Beyond article is fantastic and held my interest through out. I wish you an astounding reward in this competition.

I am particular happy for a new concept which allow fresh ideas. I will also employ you to read my article STRIKING A BALANCE BETWEEN TECHNOLOGY AND ECOSYSTEM For easy access considering the enormous entries it is here. http://fqxi.org/community/forum/topic/2020

Your comments and rating will be appreciated.

However before I leave your wall, I wish to draw your attention to your end note where you make a reference to yourself as being an atheist. Are you not contradicting yourself because your great idea of babel was taken from the Bible as you rightly quoted? Expecting your reply here and on my article.

Regards

Gbenga

Dear Mark,

An excellent thesis, persuasively argued. Only at the conclusion...hopeful. And I think of itself inadequate. Consider already the problem of net neutrality.

Humanity has a common interest to preserve its habitat, this earth. Its survival, and comfort. Yet each person has a divisive reason to exploit it as much as he can. His own survival, and comfort. As you said, it is interest which divides.

I think this can be overcome only by leading by example, by living humbly and taking action against the degradation of the earth. Deeds speak louder than words, and deeds might have the power to overcome Babel. I believe it is only through the communication of and enabling of deeds that information technology may serve as you hope.

Living humbly yet in the comfort to which we have become accustomed may require a reorganization of our society into more efficient economic units.

Good luck in the competition.

Charles

Hi Mark,

I really enjoyed your essay from beginning to end. I think it is very intelligent and well crafted. I like the way you have taken the simple observation that people often fail to understand each other and built it into a consideration of the vast array of problems facing mankind, and disagreements about them, including AI and automated weapons systems. If I have a criticism it is that when you talk about Russia and the Ukraine you are giving a particular perspective which of course others will disagree with, the occupying Russians and the ethnic Russians who want Crimea to be a part of Russia again. I also wonder whether the peaceful occupation of Crimea has prevented a larger civil war in the region that would have left many dead. I suppose it highlights how easy it is to disagree about something even when one is trying to be open minded and tolerant.

Good luck, Georgina

Mark --

I'm glad to find another essay in the contest on communication, and yours is excellent. Both successes and failures of communication have always been central to the evolution of our species, and you give a very good overview of our situation as it stands today. I like your summary of the problem:

"Even the most lucid speech requires some effort of the listener... one cannot make stones understand merely by speaking very clearly. So I want to suggest a more general understanding of Babel as the failure of communication, or of community itself... entwined with conflict, anger, arrogance and impatience, as well as distance and cognitive limits."

My own essay tries to provide some historical and conceptual background on this issue. We very easily take it for granted that we know pretty much how human communication works -- after all, this is technology we all use all the time, even when we're just talking to ourselves. But it's only in the last century that we've begun to recognize the depth and many-layered complexity of human connection. I argue that this "rediscovery" of communication is related to the emergence of electronic media, and that the cultural impact of these media is only beginning to be felt today.

Your "tentatively hopeful conclusion" is very reasonable. If you haven't already, you might look at Ray Luechtefeld's essay, which is also very good, dealing with a kind of AI support for collective understanding. I see you've already commented on Sabine Hossenfelder's essay.

Unfortunately it seems almost inevitable that "super-intelligent systems" will be controlled by the only entities capable of creating such things, namely global corporations and (not to sound too cynical), the governments they also more or less control. On the other hand, I think it's possible that the decentralized kinds of communication we now see in a fairly trivial form in "social media" might turn out to play a powerful role in transforming global culture. Our future may possibly be less dependent on what large institutions and super-powerful computers can do for us, than on what we learn to do with and for each other, given these newly-emerging dimensions of connectivity.

Thanks for a fine piece of work -- Conrad

Dear Mark,

Glad to see your reply. Although your saying as "preserving the Nature from which we came" is beyond the scope of this forum otherwise I would demanded for a proof! Your name as "Mark" has its root from the Bible you claimed as the book of wisdom. Many atheists I know hardly make reference to Bible as their basis of philosophy but your theory and even the name revolve round that book of wisdom. Anyway back to business!

I wish to read your comments on my article. It will ever refresh minds even after this contest is all over. However comments without rating will not complete. I anticipate you. http://fqxi.org/community/forum/topic/2020

Wishing you the very best in this competition.

Regards

Gbenga

Dear Mark,

Good analysis. Of course the same bible that tells of Babel does predict much later the emergence of what it calls an impostor. Now assume for a while that the LORD in the Babel story foresaw and was actually trying to prevent the emergence of an impostor/AGI. So now when it does finally come (as you hope and the bible predicts) then are we confronted with the real danger of an actual operational pseudo "LORD". This in my opinion is the moral of the Babel story; the Lord (authentic) which did scatter Babel must remain the Lord absolute. I see this as the reign of uncertainty principle as against the reign of an entity i.e. authority principle.

I see any authority principle (e.g. AGI) ultimately as a hidden variable theory and the "lord authentic" as the core uncertainty principle (of which we individuals must remain the prime example for it said somewhere "in the image of God made He man..." and in another place also speaking to man it says: "ye are gods".

The Lord at Babel does not pretend to be an ontology. Just as the today the uncertainty principle of quantum physics does not pretend (a la Copenhagen) to be an ontology. And I have actually tried to show that man is his own very uncertainty/quantum.

I agree with you that the fundamental question about AIG is, "Who will control it? If governments, corporations, and wealthy individuals determine the use of super-intelligent systems, they will likely use them as instruments of warfare and competition. Worse, if technological systems themselves are allowed to be in control, they may do things no human being would choose."

Of course they were made in the first place (even according to you) to do things no human being could do!

Really the question is: by what extent is this prospect avoidable anymore?

I will appreciate your candid critique of Between Uncertainty and Entity .

Regards,

Chidi

LOL! It's no insult, that's for sure.

Best,

Tom