Rob,

You are missing my point. He is still using a single base number system - than of logs. It doesn't matter which base he uses, as they are inter-convertible.

We all use a single base number system, be it decimal or binary. We don't really know of any other one as we have been using decimals and logs for a few hundred years.

Is that system the best one that can be built? Or can a better one, say using multiple bases in the same number representation, be devised? Such a system might be able to represent numbers we cannot today. If so, then these calculations MAY need to be revised (as well most other ones).

A (poor) analogy is the Romans attempting to build space ships using their Roman numeral system. The calculations would be much too hard and many measurements could not be performed (as they could not properly represent Real numbers). They would not be able to make certain measurements we can today, without proper scaling of numbers.

Might we be in a (somewhat) similar situation, where a more powerful numeric system could be devised that would alter what and how we measure and/or calculate?

Then a different value, inexpressible today, would change what a bit can represent.

As I understand things, Shannon is saying this is the absolute limit regardless of mathematical tools. I am suggesting his statement needs to be limited to the tools we are currently using and there might be a different way, since there might be better mathematical tools.

Don

Don,

"We don't really know of any other one as we have been using decimals and logs for a few hundred years." Most modern, communications systems don't encode information with any numerical system - they use "alphabets" of peculiar waveforms. For one example, see the wikipedia article on Quadrature Amplitude Modulation. These strange alphabets get translated into bit-patterns, not numbers, by the receiver. A second translation step might interpret those patterns as sets of numbers. But it might also interpret them as sets of alphabetic characters, like the ones I typed and you are now reading.

"Then a different value, inexpressible today, would change what a bit can represent." It already does that - it represents both nothing and everything. Bits of information are not like bits of data. It is not like a measurement that has a most and least significant bit or digit. It is like an index number - an index to a look-up table. Consequently, what that index/number "represents", is whatever totally arbitrary stuff you may have placed into the Table, at that index location. In other words, what it "represents", has no relation whatsoever, to its numerical value. You can change what the number represents, by simply changing whatever "stuff" is in the corresponding location of the Table. One such looked-up meaning, of an index/number, might say "compute the square-root of pi. Another table, for the very same index/number, might say "slap your face with your right hand." It is completely arbitrary - having no relationship whatsoever, to the value of the index/number.

Don't feel bad, if you don't understand; few physicists do either. It is related to the "measurement problem" - few physicists seem to realize that physical entities do not have to treat measurements as measurements - they may treat them as indices (symbols), resulting in a total disconnect between the "value" of the supposed "measurement" and the "meaning" of the measurement, in the sense of what behavior a system undertakes (compute sqrt(pi) versus slap your face) as a result of performing a measurement and obtaining some particular value for that measurement.

Rob McEachern

5 days later

Philip and Georgina,

When it comes to "there is more to be learnt about foundations from biology.", I harken back to a day long ago when I was struck by the physical symmetry of the classic Platonic Solid, the Octahedron. It has a number of planar aspects we find replicated in chemical arrangements into molecules and interactions, and shares an internal angle with the narrow range of the Brewster Angle which polarizes light in a laser. And among the most primitive known viruses, are octahedral entities. I have ever since had a waking nightmare that science will someday discover 'the spark of life' in that symmetry, and a naturally occurring compounding of energy that animates even the simplest volume in seeking form. Not too far from many a primitive religious belief that all things are imbued with a 'spirit'. I doubt we as a species have the wisdom to know such things. We could become Borg! :-) jrc

Thank you very much for the essay. Only real entities can act be acted upon. If various objects mentioned in your article (under different categories) are real, they would have objective reality and positive existence. These qualities can be provided only by their substance. Therefore, whichever entity provides substance to these real entities is more fundamental than any of them. You mentioned, "Our reality is what we experience". Our senses and instruments also have limited capability. Entities, we do not sense or experience but have substance, are also real. Our inability to experience them would not make them unreal.

An entity, its parameters, its properties or its actions cannot be defined by its own products. Therefore, products of substance cannot define substance. Since we, ourself, are formed by fundamental substance, it is impossible for us to define substance, the most fundamental entity. Most logical candidate for substance of all real entities is 'matter'.

    Philip,

    Most stories about fundamental aspects of nature start at a fairly high level. In other words, the considered aspects are not at all fundamental. Still, reality appears to exhibit structure and that structure will be based on one or more foundations. The search for such foundation has been undertaken several times and not with much success. The reason is that physics took another route. It works by interpreting and precisely describing observations. At the same time, it mistrusts deduced statements. This attitude inhibits the exploration of existing foundations.

    Garrett Birkhoff and John von Neumann most probably discovered one of the foundations of physical reality. This entry point was never seriously explored. See: The Incredible Story About the Reality; http://vixra.org/abs/1801.0033

      Right, now that my essay is up to illustrate where I'm coming from, some more comments.

      I like how you characterized your approach over in my thread---as 'pushing back' the fundamentals. This somehow seems very intuitive: the more general the mathematical structure, the less assumptions have to be made, and the less attack surface for 'But why this?'-type questions exist.

      But does this process have an end? In some sense, you can always generalize further---throw away some more axioms, to put it starkly. When are we general enough? Is there some endpoint that does not contain any assumptions that can be rationally doubted---and even if so, does this say something about the world, or about the boundaries of our reason?

      Exceptional structures seem to be good candidates for endpoints, in particular because they lend themselves to chains that actually do seem to terminate. Octonions are the division algebra with the highest dimension, things stop there---but then, why division algebras? E8 is the largest exceptional simple Lie group, but why any of that?

      That said, I can certainly relate to the intuition that there's got to be some mathematical object of maximal symmetry, something ideally self-justifying, which---one might hope---gives rise to observed phenomena through some process of iterated emergence, be that symmetry breaking or multiple quantization. So this is kind of a point where I have my doubts whether the whole thing works---but would love to be proven wrong.

      The "Why this?" question is an important driver in my thinking. I should perhaps have mentioned it more as you have. Of course it is nothing new. Wheeler asked what gave the equations wings to fly? Hawking asked what breathes fire into the equations?

      I know some people see exceptional structures like E8 or the octonions as something that can answer this question. These things do seem to turn up, but for me they don't answer the "Why this?" question. I feel a bit like the annoying who just keeps asking why? every time something is explained to them. If any information is needed at all to specify the way things are then there is still a question to answer.

      One candidate for a solution is that you just keep pushing back through layers of emergence until you arrive at a system with no information, where everything is possible. This is like Tegmark's MUH. This has problems. Firstly you need to define some measure or weight on the space of all mathematical possibilities and that introduces an unsourced system of information. Again I would ask Why this? Secondly, it does not explain why there is order and symmetry in the universe. If anything can happen we should live in a world where anything is possible. We might as well be living in a Disney cartoon.

      Emergence is usually something approximate. The Navier Stokes equations emerge from inter-molecular forces in a fluid, but if you look closely enough you can see the molecules. I think the emergence of space and time is like that too. If we look closely enough we can in principle see the underlying structures from which it emerges. However, I think there is a layer beyond which we can't see, even in principle. A system that emerges from a universality principle on the ensemble of all possibilities without any input of information. I know I keep saying this, but the important point that responds to your comment is why I think that it must be that way. It's because that provides the only possible answer I can think of to the "Why this?" question that fits with our experience of a rational structured universe without any external source of information.

      What is the difference between a necklace and a mouse? The mouse, or maybe it was moose, is a chain of Lie algebras. The vector spaces in the representations of these algebras form a sort of quiver. It would seem to me that in some setting if the group is a quotient H = G/K, then This algebra corresponds to a Hermitian symmetric space. An elementary example are the Grassmannian manifolds. This is an interesting development, where the local charts on the manifold are made of vectors that locally are a Lie group, and the atlas construction is a moose or what appears to be a necklace.

      My essay have finally showed up. I can now vote and gave your essay a boost.

      https://fqxi.org/community/forum/topic/2981

      LC

        Hans. I agree that theorists have always looked at too high a level for fundamentals. This even goes back to Plato when he named the elements as earth, water, air and fire. We now realize how wrong that was because we have penetrated several levels of structure further down, and yet many physicists still think that elementary particles will be fundamental. I am saying that if it requires information to specify how it works then a theory can't be fundamental. there is still some way to go before we reach that point.

        I will read your essay to better understand your point of view.

        Lawrence, I have not heard this mouse/moose terminology before. Is there a reference?

        I am looking at your essay, but may take a few days to comment.

        Nainan, What you say seems to make perfect sense.

        I have your essay on my list to read.

        I see your point regarding the approximate nature of emergence---although we often try to do so, one can't really stratify the world into neatly separated layers and expect them to stand on their own. Your notion of the 'layer beyond which we can't see', however, is somewhat opaque to me. What makes it so that we can't see beyond? Is is a limitation of human nature, or of the world as such? Could perhaps some alien scientist see beyond, only to be stumped at another layer, or perhaps, not at all?

        I think that possibly the main difference between our approaches may be that you keep on asking the 'Why this?'-question, while I, on the other hand, think that it's ultimately not the right question to ask, and might only seem to make sense to us thanks to the way our own thinking is structured.

        These are the ideas I am struggling with so I don't have clear answers, but here is how my thinking goes. Imagine you were able to run some simulation of a small world on a very powerful computer, so that within that simulation there is an intelligent entity that can examine its world. The entity could observe the artificial laws of physics that you were simulating, but it could never see what programming language you used or the hardware details of the computer you were using. I think this last layer must be similar in a way. We can't see the details of the ensemble of mathematical possibilities from which the bottom layer is emergent. We don't get to see the mathematical symbols or the choice of axioms.

        There are also examples of this from physics. Near a critical point in some system of statistical physics you can get scaling behavior. If you take the limit at the critical point and rescale than the details of the statistical physics system shrinks to zero and vanish. A quick google search brings up this talk on the subject.

        Both these examples are based around types of universality. In the first case it is the universality of computer languages that gives a definition of computability that is language independent. In the second case it is universality in critical systems. I think that something like this is happening at the bottom layer of physics. It's a form of emergence but it is different from the approximate forms that we can unpack.

        I think symmetry emerges at that bottom level and is then spontaneously broken or partly hidden as space and time emerge higher up.

        I do agree that there is a danger of being misled by the way our thinking is structured. I am quick to criticize when I see people thinking in terms of temporal causality. The same may apply to reductionism in the form that I am using. The "how" may be more important than the "why." However, there is also a danger of throwing out too much so that we find ourselves lost and unable to do anything. Perhaps it is necessary to keep some philosophical principles as scaffolding to build on. They can be removed later.

        There is this paper

        Strings from Quivers, Membranes from Moose

        Sunil Mukhi, Mukund Rangamani, Erik Verlinde

        A moose sounds very similar to a necklace. Both are in effect chains of Lie algebras.

        Cheers LC

        Ah, yes, I see what you mean. I think David Deutsch mentions such worries somewhere. On the other hand, I once had the idea that this means we're already at the end of our search for a fundamental theory, and it's electromagnetism (or any other theory capable of describing universal computers): because whatever the fundamental theory happens to be, if it is computational, you can write a program simulating it and run it on a computer. This computer can then be described via Maxwell's equations, thus showing that we need nothing else to describe the world. (I sometimes wonder if the dualities between various theories could not fruitfully be understood as a kind of reduction, in the sense the term is used in computer science, but that's another discussion.)

        Of course, this really just means offloading all the work to the initial conditions---essentially, the configuration of electromagnetic fields describing the way the computer is programmed. But this highlights another facet of the 'Why this?'-problem: it seems that any fundamental theory, in order to describe a given universe, is going to need some initial conditions. But well, why those? Is there really a set of initial conditions such that they are self-justifying?

        And then there's the question of why the simulation starts at some pretty deep down level. Why simulate nature at (say) the Planck scale? In principle, it should be possible to simulate higher-level physics just as well---the way Newtonian physics is simulated in modern computer games, for instance. I mean, one could probably mount a simplicity argument here, but again, if there still is some finite complexity, one could always go more simple, and if there isn't, well, it seems difficult to even think about what the 'program' would be like---in a sense, it would be (again) no program at all...

        Hi Philip,

        It was a real pleasure to read your contribution to this contest.

        The first half is like I could have written it myself, but each of us have a different way of explaining our perceptions.

        The second half of your essay is a witness of your dedication to mathematics, but your end conclusion NOTHING IS EVERYTHING is the same as mine, only I add "INITIATIVE" as a property of Consciousness.

        I hope you will also have some time to read and rate my essay : "Foundational Quantum Reality Loops.

        Thank you for making me think again.

        best regards

        Wilhelmus

          Dear Philip Gibbs,

          You wrote: ""Fundamental" is an adjective to describe a level of reality that is not derived from anything else." My research has concluded that reality does not have any levels. The real physical Universe consists only of one single unified VISIBLE infinite surface occurring eternally in one single dimension that am always illuminated mostly by finite non-surface light.

          Joe Fisher, ORCID ID 0000-0003-3988-8687. Unaffiliated

          Dear Philip Gibbs,

          You wrote: ""Fundamental" is an adjective to describe a level of reality that is not derived from anything else." My research has concluded that reality does not have any finite levels. The real physical Universe consists only of one single unified VISIBLE infinite surface occurring eternally in one single dimension that am always illuminated mostly by finite non-surface light.

          Joe Fisher, ORCID ID 0000-0003-3988-8687. Unaffiliated