Essay Abstract

We engage the world via models. However, every model is necessarily incomplete: the faculty by which modeling works cannot itself be modeled, and thus, remains opaque to understanding. We thus apprehend the world with tools intrinsically incapable of encompassing it as a whole. I propose that several challenging philosophical problems are in fact expressions of this limitation. Among them is the problem of fundamentals: since every model of the world reduces to some set of fundamental facts, we expect the same thing to hold of the world as a whole. This, however, ultimately confuses the map with the territory.

Author Bio

Jochen Szangolies acquired a PhD in quantum information theory at the Heinrich-Heine-University in Düsseldorf. He has worked on quantum contextuality, quantum correlations and their detection, as well as the foundations of quantum mechanics. He is the author of "Testing Quantum Contextuality: The Problem of Compatibility".

Download Essay PDF File

Hi Jochen, you took a rather constructive approach (not to say radically constructive) to tackle the essay contest's question and you provide some interesting arguments.

Let me therefore make some probably helpfull, but also critical comments.

I conclude from your two propositions, when considered as true, that nature cannot possibly be exclusively only a deterministic system - in the sense of a turing-machine-like computation.

If we do not presuppose a larger reality, non-formalizable in nature and where the "world" you spoke of and its physics is somehow embedded as merely a strictly deterministically (computational) acting subset - then our "world" would be merely of computational nature. For this case then, according to your lines of reasoning, the interface between Qualia and object reality cannot be modeled by mapping Qualia values onto some values of the external reality (understood as a computation, hence a modeling process) and vice versa.

So the "world" you spoke of cannot possibly be exclusively only a computation, since you equate computation = modeling and therefore the physics of our universe should be modeling something it has perceived as an impression (at least as some information) before the modeling of that impression took place at all (before the big bang?). Surely, this would be a too phantastic consequence, but taking your two propositions seriously, it follows from it. At least the universe should have had a certain *idea* that it now is about to model since 13.8 Billion years and therefore there should have been some non-zero information about what to model. Either this is true or the world cannot be exclusively only a computation.

Maybe it perhaps is the other way round than you suggest - namely that the hypothesis of the "world" as being exclusively only a kind of complex, deterministically running computational system is just a *fundamental* scientific idealization - literally only a wishful model of the "world" - and not fundamental at all.

It seems to me that this must be the case, since otherwise the universe as it evolves must be permanently modeling something (unknown to us) from which it had received a certain impression (or idea) prior to the universe's very appearance on the scene. Therefore I think your approach merely does push the problem of Qualia onto another level by tacitly avoiding to explicate that your main axiom for your conclusions is that of strict determinism, hence computation, but the latter should nonetheless be able to produce some Qualia. This approach may be consistent when decomposed into the relation between Qualia and the brain / and some subset of the external world, but for ultimate reality it would be only consistent if you give consciousness a priority over computation, since otherwise the 'idea' or 'impression' the universe is currently modeling, stemming from some Qualia experience, suffers the same infinite regress as you described with human Qualia. I Additionally think that you also cannot solve this problem of Qualia by referring to a void (emptiness) without any informational content, since this would also presuppose some pure awareness of being existent. In this case, the underlying computational dynamics would running idle, so to speak, producing pure self-awareness without distinction (without a model).

The crucial point is that existence of awareness doesn't necessitate any kind of modeling due to some prior impression, as less as existence of some matter necessitates that the universe is modeling this matter due to some prior impression. I think equating Qualia completely with consciousness is problematic, because pure awareness may be without any Qualia other than that of being self-aware.

Finally, I think what you have done is taking the fundamental mismatch between Qualia and computation as a kind of proof that, albeit some things in the world cannot be modeled in principle (means its dynamics cannot be completely extracted), they nonetheless - now you generalize from Qualia to pure self-awareness - must both be kinds of computations (aka dynamical formal systems, structures).

    Hi Stefan,

    thank you for your comments. Unfortunately, I don't have time to reply to them in full right now, but I think there's a potential misunderstanding here that I wanted to try and head off.

    In a nutshell, my proposal is that the world, as such, is non-computational---indeed, I view computation ultimately as a subjective notion: a system computes only if it is interpreted as computing something. This isn't really different from other symbols (since ultimately, the states of a computing system are just symbols). A set of cracks in a rock made by natural processes a billion years ago, before any humans were around, has no meaning, even if it happens to spell out something (indeed, I remember the case of an alleged runestone turning out to be just such a natural phenomenon; nevertheless, a 'translation' of it had earlier been proposed).

    However, our minds use symbols, and---if my two propositions are right---perform computations. For this to be possible, this computation must be underwritten by a process that is not itself computational---otherwise, we'd end up in an infinite regress. The hypothesis that it's qualia that underlie this mental computation then serves to ground it, and also explains why qualia are such a challenging concept---because we can't make computational sense of them. (Note that it doesn't mean qualia are all there is to consciousness.)

    So, in brief, we use computational reason, modeling, to try and explain a noncomputational world---which is only ever possible partially. This is not such a radical proposition, really: it's the situation we've been in with respect to mathematics ever since the Gödelian incompleteness theorems. There, things are often phrased as if they're a problem for mathematics---'mathematics is incomplete', or something of that sort. But really, they're just a problem for mathematicians: because human mathematicians are limited to effective, formalizable means, no axiomatization we could come up with can encompass 'all of mathematics'.

    If I'm not completely off-base, then the same thing holds of the physical world: no model ever encompasses it completely. Consequently, holding any particular model's base facts as 'fundamental' is just as misguided as thinking of any particular set of axioms (that are accessible to human mathematicians) as 'the axioms of mathematics'.

    As for determinism, that's actually an interesting question I didn't have the space to engage in the essay. Basically, you can represent every noncomputable function as a computation augmented with a string of random numbers (see, e.g., here). Consequently, a computational reason, faced with a noncomputational world, could at best understand it as some deterministic evolution with interspersed random events---which is of course exactly what we actually have in quantum mechanics. So here, too, the hypothesis that we're trying to apprehend a noncomputational world with computational means seems to hold some intriguing explanatory potential.

    To me, this seems then a fairly simple idea, with precedent in pure mathematics, that serves to elucidate many otherwise puzzling features of the world.

    I'll try and get back to some of your more in-depth remarks and questions when I have more time.

    Hi Jochen, thanks for the almost immediate reply, which clarifies a lot for me about your approach.

    It seemed to me by reading your essay that there is a huge contradiction in assuming that the 'mysterious' interface between Qualia and the external reality should not be computationally describable in principle, but nonetheless should work via a deterministically acting (turing-complete) mechanism.

    This arose to me as a mystery par excellence, since it then would transform the mystery of Qualia itself into the mystery of how one can justify to having the cake (a turing-complete interface) and at the same time eat it (having Qualia and consciousness defined as being completely equivalent to to a turing-like computation).

    Therefore I wrote that maybe it perhaps is the other way round ---- and asked myself why nobody can see the possibility that it is no wonder that Qualia isn't computationally definable ----- because it may turn out that computations, at least deterministical ones, are not the only things that reasonably can exist.

    You wrote that

    "But really, they're just a problem for mathematicians: because human mathematicians are limited to effective, formalizable means, no axiomatization we could come up with can encompass 'all of mathematics'."

    Yes, I fully agree; and I would add that it is only a problem if one has a platonic view of mathematics and its axiomatization as an eternally fixed (infinite) set of (infinitely) complex relationships.

    It would be interesting to me whether you define the process that underlies our mind's capabilities to perform computations as 'computations' in the sense that they are augmented partially with a string of random numbers - for example for human decision processess.

      Jochen, anthropologists are always trying to identify some "unique capacity" of humans that separate us from less evolved creatures, but the zoologists always spoil the idea. For example someone once claimed that humanity is an ability to make and use tools, but even animals such as birds and fish have been observed to use and even make simple forms of tools. I fear that our capacity for "constructing internal models of the world" may go the same way. Luckily this is a side issue that I think does not affect your main thesis.

      Your essay has some ideas very much in tune with my own, but it also has some opposites which are possibly more interesting. You share a similar view to mine on the relation between nothing and everything in the context of information theory. Your response "Why this?" in answer to any proposal for fundamental theory also resonates well with me. Because of this I push back fundamentalism to a deep level using emergence, but whereas I still hold out hope for a system of mathematical meta-laws, you seem to go further and argue that there is no fundamental theory.

      Your theory of models also seems to be opposite to mine. If we equate models with stories in my essay, then I argue that the real universe is the same as a model, whereas you argue that a model can never be the same as reality.

      Do you see more similarities or differences? Whatever the answer, your essay is well argued and gives me a useful way to question my own view. I am glad you have been able to bring it under discussion with plenty of time left.

        Hi Stefan, glad I could help some. You're right to say that it would be mysterious to first characterize qualia as noncomputational, and then turn around on a dime to claim a computational mind after all (if I understand you correctly and that is what you're saying), but that's not my intention---rather, it seems in some agreement with you, I think that qualia are noncomputational phenomena, and that our problems with explaining them ultimately come from the fact that reason, being based on models, is computational.

        So in a sense, the mind can do more than it can explain. You might think of qualia as supplying the link between our models of the world, and the stuff in the world they model---they underwrite our 'mental simulations' (i.e. computations) of the world, but are not themselves computational.

        You need something different in kind from the way computation works in order to ward of infinite regress. I think this may be better explained by considering a simplified version of the 'language of thought'-hypothesis: when we encounter, say, a Chinese text, we may translate it into a language that we already understand, say, English, to grasp its meaning.

        But how, then, is the English text understood? The language of thought-hypothesis says that there is a native language which our brains speak, the mentalese, into which English text is translated.

        Now, clearly, mentalese can't itself be understood in the same way: or else, we would face infinite regress, always needing another language into which to translate. So our minds must be capable of some other process of uncovering the meaning of mentalese, which ultimately grounds our ability to understand any language at all.

        The same now goes for computation (or model-building). A computation is ultimately just a sequence of computational states, that gets then mapped to, for instance, the states of some physical system, or derivations in some formal system, or something like that. This mapping is our translation, and in general, we can use a computation to implement this mapping (in computer science terms this is called a 'reduction').

        However, we face the same problem as above: we may interpret, say, the lights blinking on some early computer as some numerical value, and thus, the computer as implementing a certain calculation by mapping it to some abstract, mental symbols---the equivalent of mentalese. But how are they themselves understood? The process grounding this understanding can't itself be computational, or we just run into the regress again. Consequently, some noncomputational process must be at work in order to ground our mental models. This process I then propose to identify with qualia.

        Hi Jochen, lots of interesting argument in your essay. I like your "Models are at the heart of our engagement with the world. When we think about a tree, there is no tree present in our thoughts; rather, we use a mental model in order to draw valid conclusions about the actual physical system." Though the conclusions are not always valid, they can be in error. Though sufficiently accurate, enough of the time, for the purposes of our biology

        Max Tegmark has said that consciousness is "what information processing feels like from the inside,"(2014) "Consciousness as a state of matter." I'd say in that the visual qualia are, in nature, inseparable from the information processing AND not by themselves the information processing. I have called visual qualia produced form observation 'visual products'.

        Re. your "We see something like this moment repeated within small children: up to about the age of 20-24 months, they do not seem to conceive of themselves as separate entities within the world, for instance failing to recognize themselves in the mirror." My personal experience is of being self aware at birth, and aware of my individuality and separateness from my surroundings, others in the room; and very aware of the difference (among those others) between mother and not mother.

        With regard to the mirror test: I know it is a standard test of self awareness but I think the reasoning behind it is flawed. The internal experience of I is very different from recognition of external appearance. The delay in recognition is due to not identifying as me, an image seen at a place separate from the physical body, that is not identical to the internal experience of the self, and for which there is not an internal model of that as self, or stored memory to refer to for recognition. The neural pathways have to develop that are necessary for assuming the external view of me perspective.

        IE the association of internally experienced I (and the internal awareness of a body associated with that) with an image seen separate from it. In much the same way as a computer game player must learn to identify with the avatar. That is a separate ability from knowing from an internal perspective that one is separate from the external reality. Those animals able to recognize themselves in a mirror have the capability of identifying with an image separate from their own body as if it is them-self, whereas other animals lack the mental capacity for that abstraction, rather than, I would say, not having a concept or feeling of I. 'I' seems to me to have a fundamental, homeostatic, basic survival and reproductive function. Information about internal and external conditions being related to the concept of I. I am cold, I am well fed, etc.

        I would say the external reality itself, as it is, can not be known by a human, from the universe centred rather than literal human centred perspective. We do not have the capacity to experience all viewpoints simultaneously. However the external universe can still be the source of our partial knowing and partial understanding through our internal and external modelling

        I have found a lot I can relate to in your essay. Kind regards Georgina

          You're completely right to question any claims of human uniqueness---and I don't want to claim that model-building is some uniquely human capacity (in fact, earlier versions of the essay contained many caveats regarding when in the evolutionary history of humankind this capacity first came up, but that ultimately didn't add much, as nothing really rides on the precise location of that point). (Although if there's something that makes humans unique, it might be worrying about what makes us unique...)

          All I really wanted to convey is that we're not like the sphex wasp, but between that and us there's probably a lot of shades of grey. Still, the human case is most accessible to us due to introspection.

          I also think you're right about there being both similarities and differences between our approaches---this is part of why I have been postponing answering you in your thread, since now I can simply point to this essay for illustration (the other part is that I was reluctant to fully enter the fray, due to time constraints).

          I think that I used to be much closer to your outlook, seeing the world itself as a model. However, I'm now leaning towards agreeing with Whitehead regarding 'misplaced concreteness': in the end, it's at least an idea worth exploring that we're making certain issues too hard on ourselves by placing too much value in the constructs we can form to grasp the world.

          After all, as I already mentioned to Stefan above, we know something like this is true with pure mathematics: human mathematicians can only handle effectively specified formal systems, and thus, always have an 'incomplete' view of mathematics as a whole. It seems to me that stipulating that the same is true of the physical world---and I find the argument regarding the noncomputational nature of modeling persuasive---has the potential to clear up some things that otherwise would seem mysterious.

          In some sense, I'm really just skeptical that you can push back fundamentalism the way you want (and the way, I agree, it has to be), and then stop anywhere---you have to keep pushing. But then there's really nothing fundamental left anymore.

          Does that make any sense to you?

          Yes that does make sense. I also do get the point about our ability to reflect on ourselves. Even if I am skeptical about the phase transition and see it as a more gradual fuzzy change, the relevant part of the point is still valid. It is also meaningful in the context of my own essay.

          Yes, our view of mathematics is incomplete because of undecidability and the formal systems we are limited to studying. There are models of mathematical logic which may be analogous to models of reality too. Somehow the universe must avoid the incompleteness that this potentially implies if physics is based on mathematics. You have a radical solution to problems like this through the noncomputability idea. The problem I see with this is that it seems to be saying something about what reality isn't, but it does not answer what it is. Are you saying that there is no answer to that?

          I see things differently through a hypothetical principle of universality, but if that idea does not work I have to fall back on something like what you are saying. I'll say a little more about my view on my essay forum.

          You're right that my conclusion is essentially a negative one---again, this is like with Gödel's theorems: we won't find a single axiomatization of all of mathematics, it's simply too rich for that. Likewise, we can't tell a single story covering all of physics---reality is too multifaceted for that.

          But that doesn't mean the end of science anymore than Gödel's results meant the end of mathematics. I take the aim of science to be descriptive---that is, we want to describe the world, not necessarily explain it (indeed, since at least Nietzsche, many philosophers have argued that this is the only proper role of science).

          As to what reality is---well, my answer is essentially that the question is misguided. There's no 'fundamental nature' of reality; the most we can say is that relative to a certain point of view, a certain set of truths obtains.

          Basically, I think that ever since Thales, we've been chasing the spectre of some independent substance on which the world is build---the foundations that carry themselves, so to speak. Thales' water is just the first (recorded) example, but the basic idea recurs throughout Western philosophy---there's some kind of stuff, or more than one kind of stuff (as in, e.g., Cartesian dualism or other pluralist ideas), and everything else is made from that stuff.

          Eastern philosophy, especially in the Buddhist tradition, is more flexible there. The idea that there could be some such fundamental nature, some stuff that underlies everything else is denied. Rather, everything is ultimately 'empty'---free of fundamental nature---and what exists arises in a process of 'dependent origination'---think of a post-measurement, pre-'collapse' quantum state: relative to the spin being up, the measurement apparatus is in the 'Up' state; relative to the spin being down, it is in the 'down' state. (I should note perhaps that my usage of the Buddhist terms has as much connection with their original meaning as modern-day atoms have with those of Democritus---there's a continuity of theme, I think, but I'm not claiming that the ancient Buddhist philosophers got it all right way back when. Still, I think there's a reason many of the founding fathers of QM had some interest in Eastern philosophy.)

          So like you can't point to a post-measurement quantum state as having this or that particular nature, I don't think you can point to the world as a whole and claim it has this or that particular nature, either. Or, to couch things in information-theoretic language again, the world ultimately contains no information, does not boil down to a fundamental set of facts, or something like that; information, and 'fundamental' natures, only comes into play when describing merely a part of the world. But we're limited to partial description; hence, it will seem to us as if everything has some such fundamental nature.

          Hi Jochen, thanks for your comments. Yes, that was my problem. As I understand it now, you define the underlying process of connecting the stuff in the world with our mental constructs as Qualia, the latter fundamentally irreducible by any analytical means. Is this the correct version of what you are proposing? Since the problem of infinite regress and Gödel's incompleteness theorems can be regarded as two sides of the same coin (regarding self-reference), does your approach at present also involve the notion of mathematical infinities, the latter having anything to do with the fact that Qualia are at all possible to exist (as they obviously do) in the framework of your approach?

          Meanwhile I have written a reply to your comment on my essay page. I have clarified some points you may have misunderstood about my own approach and gave a rather extensive story of why I concluded in my essay what I concluded and made some more statements on how to give it a precise meaning. As always, any questions about what I've written are welcome.

          "the world ultimately contains no information" I think I am agreeing with you on this, but I would put it differently to clarify. I would say that the world (all of reality) requires no information to specify it as a whole. This has to be the case, because there is no external source from where such information could come. However, information arises internally which is relative to our personal experience of the world, including where we are in reality and how the laws of physics appear there. All the information that we gather by observation is telling us that, and of course it helps us build an imperfect and incomplete model of the world.

          Yes, the information we see in the world is ultimately just due to our relation to the world---this is what I mean when I say that it only enters due to modeling. The experience you speak of, to me, is a kind of model of the world---after all, we do not experience outside reality in some direct sense, which is obvious due to the fact that our experience is so often misleading.

          We see a tiger (or a face) that isn't there because we generate hypotheses about the world---models of the world---and try to refute them using our sensory impressions, and once a hypotheses has withstood enough testing, it is accepted, at least on a provisional basis. The evolutionary reason for this is, of course, that it's better for one's survival chances to run away from a tiger that isn't there than not to run if there is, in fact, a tiger.

          But I think I haven't really answered your earlier question---I am saying that there is no answer to the question of how the world 'really is', but not because I believe that to be some ineluctable mystery our minds cannot hope to grasp, but merely because the question is ill-posed. And in a sense, you agree: if the world requires no information to specify, then there's no shortest description of the world. The only thing you could say when asked to define the world, its fundamental character, whatever, is literally nothing.

          Hi Georgina, thanks for your kind comments, I'm glad there was something for you in my essay.

          Regarding the mirror test, I actually mostly tend to agree with you: it's certainly not necessary to be able to pass that test in order to have a sense of self, but I'm merely taking it the other way around---that having some idea of what 'you' are is necessary to pass the mirror test. Because by passing that test, a child, or ape, or bird essentially says 'that's me'; so there needs to be an idea of 'me' beforehand. I agree, though, that this isn't really clear from the way I put it in the essay.

          So I think it's very well possible to have an internal experience of an 'I' without being able to pass the mirror test. Another example of such a situation might be with animals whose primary sense modality isn't vision. For instance, for a dog, vision just might not play enough of a role to take it into consideration enough to do all the data processing necessary to correlate the image in the mirror with itself; but a smell-o-vision version might be no problem (not that I know how that might look, exactly), while I could easily imagine humans failing such a test without our self-hood thereby being called into question.

          Hi Stefan, yes, I think you've got the gist of my idea there. Qualia are mysterious, because they're not amenable to model-based reasoning; and they're not amenable to that because otherwise, we would end up in an infinite regress.

          Regarding infinity, well, I'm skeptical of the physical implementability of anything actually infinite---after all, I consider something being only possible by traversing an infinite regress to be something that's actually impossible. Otherwise, I could just hold that well, you need an infinite number of computations to subserve modeling, so what?

          But I think that doesn't mean that the notion of infinity doesn't have any value in thinking about the world. For one, there might be open-ended processes, which, while not infinite at any instant, nevertheless also can't be called finite. Furthermore, there are possibly things in the natural world that must seem infinitary to a computational reason. True randomness, for instance, cannot be produced by any finite computer program. But an infinite program could, in principle, produce a random real number (by the trivial method of storing infinitely many digits, for instance). So if the universe is an open-ended process, and quantum mechanics is truly random, then there is no finitary concept that suffices to capture it.

          Regarding your reply on your essay page (which is almost another essay in itself), I probably won't get around to replying to that before the weekend, so I'm gonna have to ask for a little patience here...

          Hi Jochen, thanks for clarifying. You are right, infinity can also be defined or understood as something being not finite (I am tempted to write indefinite instead...). Yes, this makes sense, since the result of many processes, in the manner we discuss them here, cannot be figured out in advance, for example by simulating these processes. Best example: I cannot exactly simulate and therefore predict what I will know, do or think tomorrow.

          For my own approach to be consistent, i need a certain variant of infinity, since i purport the view that some eternal truths must exist (surely then in a realm beyond traditional time and space).

          My reply to you on my essay page has been facilitated in a hurry, containing some grammar and syntax errrors. But I think at those passages, one can nonethless decipher what I intended to say. Yes, I think it is the longest comment I ever wrote in the internet...:-) For me, the whole essay theme is fascinating and I consider the contest's question as important in itself, notwithstanding of possible negative answers to the question. Anyways, take your time to read it, and I would be happy if you could again comment it.

          Thanks for your reply. Really good point about the different priority given to different kinds of sensory input by different species. I think it might be confusing for a dog to smell'itself' somewhere else, that it hasn't been and left its smell. I don't think I would recognize my own smell in isolation but imagine I would be able to eliminate not my smell of other people. And you are right we would not have the same kind of relation to the smell information as a dog. We would not identify that external stimulus with internal sense of self -causing the dog scientists to question our self awareness : )

          I agree that because there can be no external source of information, the foundations must start from the idea that everything is possible, but I won't yet give in to the idea that we cannot grasp how it goes from there. I accept that nature as we observe it is in part the result of unpredictable accidents that selected a particular vacuum suitable for introspective life to evolve, but there is order and structure and symmetry in nature too. There has to be some theory that provides the framework from which universes emerge. This is why I think there has to be a principle of universality from which a mathematical structure forms. The most likely case is that this is spontaneous and unique so that no further information is required to specify it.

          In truth I believe in this only because we exist in a structured world, but if it is correct there should be some way to understand it in its own right. I think the kind of logic you use in your essay is the right way to think about it. I.e. it is about experience, information, modelling and the iterative nature if introspection, but there should be a different conclusion from the one you came to. At a guess based on what we know about quantum field theories, gravity and speculative combinations of the two, I think that the iterative arguments lead to a version of iterated quantisation that converges to an algebraic structure. This can then be mapped to the landscape of possible geometric universes via the magic of algebraic geometry. That is a difficult area of mathematics that challenges the ability of the best mathematicians. There may be much more that is unknown and even harder to grasp, but I think there are signs that the human mind can reach there. If it can't find it we may have to wait for some superior artificial intelligence to explain it to us.

          Dear Jochen, I am impressed by your very methodical way of presentation and building of arguments / conclusions.

          I cannot do but agree -->

          The question "What is fundamental?" is already misguided: our instinct for searching for the fundamental is simply due to our model-based reasoning.

          Best Wishes

            There might be another interpretation of your conclusion, which is that you are agreeing with me when I say that we cannot see beyond the point of universality.