Essay Abstract

There are many ways we can not know. Even in systems that we created ourselves, as, for example, systems in mathematical logic, Goedel and Tarski's theorems impose limits on what we can know. As we try to speak of the real world, things get even harder. We want to compare the results of our mathematical theories to observations, and that means the use of inductive methods. While we can demonstrate how an ideal probabilistic induction should work, the requirements of such a method include a few infinities. Furthermore, it would not be even enough to be able to compute those methods and obtain predictions. There are cases where underdeterminacy can not unavoidable, such as the interpretation of quantum mechanics or the current status of string theory. Despite that, scientists still behave as if they were able to know the truth. As it becomes clear that such behavior can cause severe cognitive mistakes, the need to accept our limits, both our natural human limits and the limits of the tools we have created, become apparent. This essay will discuss how we must accept that knowledge is almost only limited to formal systems. Moreover, even in those, there will always be undecidable propositions. We will also see how those questions influence the evaluation of current theories in physics.

Author Bio

André C. R. Martins is an Associate Professor in the School of Arts, Sciences and Humanities (EACH) at Universidade de São Paulo (USP). He holds a PhD in Theoretical Physics and was Visiting Professor at École Polytechnique, at the Research Center in Applied Epistemology (CREA) in Paris. At EACH, he coordinated the creation of the Masters program in Modelling of Complex Systems.

Download Essay PDF File

Dear André,

there is a lot to unpack in your essay. I think your main question, however, is a simple one: when is it reasonable to believe something? This seems a straightforward question, but, as so very often, there are many subtleties that confound finding a straightforward answer.

You start out by noting that, contrary to mathematics, physical theory always includes an issue of vagueness: initial conditions are contingent facts about the world that can only be imperfectly known, thus making all of our predictions---and hence, beliefs---essentially probabilistic.

Furthermore, the very means we use to interrogate the world to check our predictions turn out to be, themselves, dependent on yet further assumptions, theories, and contingencies---a point sometimes framed as the 'theory-ladenness of data'. We do not simply observe the world; our means of observation themselves contain nontrivial assumptions that are usually ignored.

On top of that, what we do end up believing ends up defining who we are---making any attack on our beliefs, whether by argument or by unwelcome fact, an attack on our very self-image, against which, we must defend ourselves. Hence, we close ourselves against that which does not already fit our beliefs.

Human reasoning is not a truth-finding engine, but rather, a means of social cohesion---I was happy to see 'The Enigma of Reason' in your references, which, I think, defends a very sensible thesis regarding human cognition.

You also note the uncomputability of methods of inference. I wonder if you're familiar with Solomonoff's work on universal priors---essentially, it amounts to formalizing Occam's razor as preferring the most simple program, in the sense of algorithmic complexity, capable of reproducing a given set of data. It is possible to formulate a theory of inductive inference ('Solomonoff induction') on this basis---which naturally ends up being uncomputable, due to the uncomputability of Kolmogorov complexity.

Markus Hutter has proposed an artificial intelligence framework, the AIXI agent, based on this, and could show that it asymptotically solves every unknown problem in the same time (in the sense of time complexity) as a special-purpose problem solver. There is much interesting work on trying to find computable approximations to AIXI.

I agree regarding your remarks on the interpretation of quantum mechanics---there is simply too vast a space of possibilities, and too little constraint from data. However, I do believe that going in the other direction---that is, trying to reconstruct quantum mechanics from suitable fundamental assumptions, rather than trying to reconstruct the underlying ontology starting with the quantum formalism---to be possibly more fruitful. If you think that's interesting, perhaps you might want to have a look at my essay.

Cheers

Jochen

    Dear Jochen,

    Yes, that is the main question. We actually have no logical support for believing in anything, except in a probabilistic way. While I agree there is theory-ladenness of data, I do not think it is an essential limit as many others I discuss. For me, in essence, it is a problem of translation. Different theories provide us with their own languages we use to interpret things. But we can always revert to the most basic description of the data if we really must. Suppose someone would propose some crazy theory with none of our fundamental particles. That would indeed make it hard to describe many basic experiments. But hard is not impossible. Instead of saying we have observed an electron, for example, we can say we have seen some patterns on a computer screen.

    I do know about Solomonoff and have mentioned SI at the end of page 7. The essay size limits did not allow me to say more, however. I do discuss it in length, in a chapter by itself, in my coming book, "Arguments, Cognition, and Science" - https://rowman.com/ISBN/9781786615077/Arguments-Cognition-and-Science-Consequences-of-Probabilistic-Induction-in-Science

    Hutter AIXI approach, however, is new, and I will need to check it. Thanks a lot for the reference.

    I did take a look at your essay, and I found the concepts of finiteness and extensibility quite interesting. Quantum mechanics does seem to work as you describe. You also did an outstanding job of explaining the fundamental problems in measurement. I did enjoy reading it.

    Cheers,

    André

    a month later

    Dear Andrè (if I may),

    Very clear and interesting essay. I find particularly inspiring your words, when you state: "However, we have to compare those predictions against what we observe, and predictions are never exact, even for deterministic theories. Experiments have errors. The constants in any theory are only known up to limited precision." I could not agree more! I think you might have an interest in having a look at my essay, where I introduce the possibility an indeterministic alternative to classical physics. These present remarkable similarities.

    Concerning the Bayesian model, are you familiar with QBism as an interpretation of quantum mechanics?

    Meanwhile, good job, top rate!

    All the best,

    Flavio

      Dear Flavio,

      You have written a very nice piece there. Yes, misconceptions among physicists are common, even if most of your conclusions have always been quite obvious, your information treatment makes yours a rather nice paper. There is no way to be certain about the real world, even when using deterministic theories, and you show that clearly. I don't actually see that as an alternative to classical physics but the only way to do it right, everything else is an approximation.

      On QBism, I am quite curious about it, but still need to study it seriously. That is something I MUST do soon.

      Best,

      André

      a month later

      Dear André Martins

      I enjoyed reading your essay, specially the discussion on cognition and Bayesian methods. It is well written and fluid. I am afraid I have no criticism, your discussion is well argued and aligned with the topic of this contest.

      Good luck!

      Regards, Israel

        Hello André,

        Very nice to see this piece in the mix (the first one this year I've read, so I guess I now have primacy bias.)

        One thing I really like here is the hidden (recursive) problem of knowing for Bayesians: errors are distributed how? And according to what prior? And what's the prior on that, and the errors, and so on.

        The standard story (for the Bayesian who want to "ground") is Jaynes' Max-Ent priors story which can't work once the system has unrestricted state space. I think. One hopes to construct a Max-Ent story that's invariant under system symmetries, but even there, there's a need to specify the symmetries and constrain one's beliefs in them. e.g., some Loop Quantum Gravity people want to violate Lorentz invariance, which means that a prior that is invariant under LI is wrong.

        PS: amusingly, our opening sentences have rather a lot of parallelism. There are many things we can not know, indeed!

        Simon

          André,

          Lots of good points in your essay. A major point in your essay, keeping an open mind, is one which I also emphasize in mine. Confirmation bias is a danger when setting out to prove a hypothesis which also often guides the methodology used. As you say, we need to diminish the influence of human subjectivity in our conclusions. When you say that computational models are more reliable than human cognition, it calls to mind the algorithym that the Soviet Union used to detect incoming ICBMs that failed due to detection errors programmed into it. An attending engineer was a planet-saving check on the system. So as you know in your field, human cognition can error with inputs, something you mentioned "understanding our limitations is crucial.

          Hope you get a chance to read mine.

          Jim Hoover

            Dear Israel,

            Thank you for your kind words, I am glad you enjoyed reading it.

            Best,

            André

            Dear Simon,

            Thanks for the comments. I just came back to check the thread and have not still read entries for a while, I am planning to do it next. And check the parallel between our opening sentences, for sure!

            And yes, using Bayesian methods fully is impossible. I still feel we should know what it would take so that we can guess a direction to move forward. After all, we can demonstrate, as Jaynes did, we should use Bayesian probabilities to work with plausibilities. There is just this pesky problem of a few infinite requirements to do it right...

            André

            Hi, Jim

            I just came back to the page, I am planning to go and read some essays tomorrow. I will include yours in the list.

            And yes, our cognition can cause quite a few problems and we should be wary of our own reasoning, I obviously fully agree. Computational models can certainly go wrong, as they depend on who is implementing them. But they should provide a more reliable account of the consequences of a set of assumptions than we could get otherwise. Just as any kind of logical or mathematical tools would do.

            André

            7 days later

            Dr Andre Your work on cognitive limitations is spot on,quite vivid in placing indeterminacy on a mathematical scale by implementing Bayesian analysis.Perfectly done. Are basic cognitive mechanisms which give rise to our world preconditioned by our environment? kindly read/review how it all impedes on our knowledge here https://fqxi.org/community/forum/topic/3525.thanks all the best.

              Thank you for your kind words, Michael.

              I will take a look at your paper. Anyway, it does seem our cognitive mechanisms are heavily influenced by the environment of our ancestors. Mercier makes a very strong case that we reason and argue not to find the best answers but to fit in a group because that is far more important from an evolutionary point of view. That is very strong conditioning by environment.

              7 days later

              There is a necessary correction in my abstract. Where it reads "There are cases where underdeterminacy can not unavoidable..." it should be "There are cases where underdeterminacy might be unavoidable..."

              Andre,

              I have commented on you essay but discovered I have not rated it yet. Time grows short so I am now rating it, being your 10th rating. My reason for mentioning this is that many ratings are 1s or 2s w/o comments. I remember I enjoyed reading your essay a few weeks ago.

              Jim Hoover

              Write a Reply...