Dear Tim,

This is a very nice contribution to efforts to reconcile quantum indeterminacy with classical mechanics by invoking classical chaos theory. Your arguments are convincing. But where do complex numbers and amplitudes come in? They are necessary for quantum mechanics in general and non-local quantum correlations in particular. I'm sympathetic to getting intrinsic uncertainty out of classical chaos. But it seems like something is still missing. Please enlighten us even more!

Yours,

Seth

Dear Seth

Thanks for your input. I fully agree that complex numbers are central to quantum theory.

To understand the emergence of complex numbers in my fractal model, could I refer you to the technical paper recently published in Proc. Roy. Soc.A (open access):

https://royalsocietypublishing.org/doi/10.1098/rspa.2019.0350

on which this essay is based - some aspects of which are summarised in the Appendix to the essay. In particular, I construct a particular fractal geometric model of (what I call) the state-space invariant set based on the concept of fractal helices (see Fig 4 in Section 3 of the paper). At a particular fractal iteration, the trajectory segments of the helix evolve to specific clusters in state space - these clusters representing measurement outcomes/ eigenstates of observables. I then describe this helical structure symbolically (BTW symbolic dynamics is a powerful tool in nonlinear dynamical systems theory for describing dynamics on fractal attractors topologically). In the case of two measurement outcomes, the symbolic descriptions of the helix are then given by finite bit strings. Now in Section 2 of the paper, I show than I can define multiplicative complex roots of unity in terms of permutation/negation operators on these bit strings. A very simple illustration of this is to take the bit string

S={a_1, a_2}

where a_1, a_2 in {1, -1} - as a representation of a pair of trajectories labelled symbolically by which of the two distinct clusters ("1" and "-1") they evolve. Now define the operator i by

i S = {-a_2, a_1}.

Then i^2=-1 if -S={-a_1, -a_2}.

In fact, even more I can define quaternionic multiplication and hence Pauli spin matrices (and hence Dirac gamma matrices) in terms of certain permutation/negation operators on longer finite bit strings. See the paper for more details.

This answers half of your question - about complex multiplication. The second half of your question - relating additive properties of such bit strings to the additive properties of complex numbers - is something I am currently writing up. It turns out that to do this I have to extend the number-theoretic properties of trigonometric functions which play a vital role in the particular discretisation of the Bloch sphere described in the paper cited above - see also below - to number-theoretic properties of hyperbolic functions. Whilst the former provide a natural way to discretise rotations in physical space, the latter provide a natural way to discretise Lorentz transformations in space time! In this way, I have some belief that the properties of the invariant set are more primitive than those of space-time, with the prospect of the latter emerging from the former. With the current lockdown, I should have a draft paper shortly! With this, I will have a complete answer to your question.

However, a crucially important point in all this is that I do not, and will not, recover in this way the full *continuum* field of complex numbers, but only a particular discrete subset (essentially those complex numbers with rational squared amplitudes and rational phase angles). These complex numbers play an important role in my model for describing the symbolic properties of the helix in a probabilistic way. Number theoretic properties of trigonometric functions applied to these discretised complex numbers provide the basis for my description of quantum complementarity (and indeed the Uncertainty Principle - see Section 2e of paper above). However, in my model there is no requirement for these complex numbers to be arithmetically closed. Such arithmetic closure arises at the deeper deterministic level and this can be described by the arithmetically closed p-adic integers, these providing the basis for a deterministic dynamic on the invariant set. (There is a rich theory of deterministic dynamical systems based on the p-adics.)

All this means that in describing my fractal model from a probabilistic perspective, I can and do (in the paper above) use the formalism of complex Hilbert vectors (and associated tensor products). However, these vectors are required, by the discretised nature of the helix of trajectories in state space, to have squared amplitudes which are rational numbers and complex phases which are rational multiples of pi. Importantly, almost all elements of the complex Hilbert Space *continuum* have no (ontic) correspondence with probabilistic descriptions of the invariant set helices.

My own view is that quantum theory's dependence on the *continuum* of complex numbers (i.e. through the continuum complex Hilbert space) is the origin of its deep conceptual problems, e.g. as arises in trying to understand the meaning of the Bell Theorem or the sequential Stern-Gerlach experiment, or the Mach-Zehnder interferometer, or GHZ, or....you name it!!. Indeed I think quantum theory's dependence on the complex continuum is the origin of the difficulties we have reconciling quantum theory and general relativity theory. Of course, in quantum theory, we don't have a deterministic underpinning and so breaking the arithmetic closure of Hilbert Space is a real theoretical problem. However, in a model where there is a deeper deterministic basis, breaking the arithmetic closure of Hilbert space in this way doesn't matter a jot - since it's not a fundamental description of the underlying theory!! Here, in my view, we physicists have been overly beguiled by one aspect of the beauty of mathematics - the complex continuum field C!!

Recall that in mathematics, C arose as a tool for solving polynomial equations. Perhaps we need to retrace our steps and ask whether taking this tool onboard wholesale for describing the equations of fundamental physics could actually now be causing us some big problems (the utility of C notwithstanding)! Perhaps we imported a virus which has rather grown over the centuries and now completely permeates the core of fundamental physics making it impossible to make vigorous leaps forward! The real-number continuum virus doesn't matter in classical physics, because discretised approximations can come arbitrarily close to the continuum limit. However, the complex-number continuum does matter in a much more essential way in quantum theory. Recall in Lucien Hardy's axioms for quantum theory, the complex continuum plays a central and inviolable role - in complete contrast with classical theory. Hence in order to find a discretised theory of quantum physics, which I think should be an important goal for physical theory, quantum theory must be a singular and not a smooth limit as the discretisation goes to zero. My deterministic model has this property.

I am going to pick up on one other point in your correspondence. You say that I try to reconcile quantum theory with classical mechanics. I don't really see my proposal as "classical" in the following sense. The dynamics of classical chaos are differential (or difference) equations and the fractal attractor is an asymptotic set of states on which, classically, one never actually arrives, at least from a generic initial condition in state space. However, from this classical perspective there is no essential/ontological difference between a state which is "almost" on the attractor, and one on the attractor precisely.

By contrast, here I am postulating a primitive role for this fractal geometry (rather than the differential equations). Because of this, as I try to discuss in the essay, the p-adic metric may be a better yardstick of distance in state space than the familiar Euclidean metric. The p-adic metric certainly does distinguish between points which are not on the fractal and those that are, no matter how close such points may be from a Euclidean perspective. In this sense although my model is certainly motivated by classical deterministic chaos, I would not call it classical.

There is much more to be teased out of this model and I feel I am rather at the beginning of a journey with it, rather than the end.

Thanks again for your interest. Not sure how much you will have been enlightened, but I hope you see where I am coming from, at least!

Tim

Dear Prof. Palmer,

I really liked your esssay and especially how it emphasises the (overlooked) role of chaotic systems for the foundations of science.

I would greatly appreciate your opinion on my essay which is based on the research I am carrying out with Nicolas Gisin. I think our approaches have some similarities, for we also rely on classical chaos to introduce indeterminism in classical physics too.

I wish you the best of luck for the contest, and to get to a prize as you deserve.

Best wishes,

Flavio

Dear Flavio

Thank you for your kind remarks. Nicolas Gisin and I have already discussed some of the matters discussed in your essay and whilst I do agree that your and Nicolas's ideas are very thought provoking, I would say that we are not in complete agreement.

Let me start by remarking that I fully agree that it is possible to treat chaotic classical deterministic systems by some finite indeterministic approximation. In fact this is exactly what we do in modelling climate:

https://www.nature.com/articles/s42254-019-0062-2

which is to say that we approximate a set of deterministic chaotic partial differential equations by a finite deterministic numerical approximation and represent the unresolved remainder of the system by constrained stochastic noise. It works well!

However, I do not believe this approach will work for quantum physics, if one believes that the complex Hilbert Space of quantum theory is somehow fundamental, the reason being (Lucien) Hardy's Continuity Axiom. By virtue of this axiom, the continuity of Hilbert Space is fundamental to quantum theory.

Put this way, the continuum appears to play a more vital role in quantum theory than it does in classical theory. This suggests that if we seek some finite theory of quantum physics - which I certainly do seek - then the resulting theory will have to be radically different from quantum theory (even with a stochastic collapse model) and will not be just some approximation to it.

I can in fact state this a little more precisely. I believe that by virtue of Hardy's Continuity Axiom, quantum theory will have to be a singular limit and not a smooth limit of a finite discretised theory of quantum physics, as the discretisation scale goes to zero.

In my essay I attempt to suggest a deterministic (i.e. not indeterministic) alternative to quantum theory in which quantum theory is a singular limit (as a certain fractal gap parameter goes to zero). However, until potential departures from quantum theory can be experimentally tested, and perhaps this day is not so far away, who knows whether this really is the right way forward.

Having said this, there are clearly many points of commonality between our essays and I look forward to discussing these with you sometime!

Best wishes

Tim

I too concur and oblige that fractals offer structured patterns to which human thought assigns meaning to topological landscapes.Can anthropic bias be key to unravelling New physics that bridge the gap between general relativity and quantum mechanics. kindly read/rate how,why and where here https://fqxi.org/community/forum/topic/3525.thanks

I take a different look at fractals in my essay

Please rate:

Please take a look at my essay A grand Introduction to Darwinian mechanic

https://fqxi.org/community/forum/topic/3549

Dear Tim,

I enjoyed reading your essay and learned a lot of things on the chaos theory. Because I also studied the quantum nature from the viewpoint of quantum walk related to quantum chaos, I would like to know the clarification on the stochastic nature and chaotic nature. From your viewpoint, what do you think about this relationship? As in my essay, the chaotic theory is completely different from the stochastic thing from the viewpoint of computation. Therefore, I would like to know your opinion.

Best wishes,

Yutaka

    Dear Yutaka

    Thank you for your question. From the perspective of my essay, stochastic and chaotic dynamics are very different concepts. Let me give an example. In my essay I wrote down the equations of the famous Lorenz model which is chaotic for certain parameter values. For standard chaotic values of the parameters, about 96% of the variance of the model lies in a two-dimensional sub-space of state space. Now one can choose a basis where you retain the dynamical equations in this two-dimensional subspace, but replace the dynamics in the third dimension with a stochastic process. The resulting attractor looks superficially like the Lorenz attractor. However, it differs in one vital regard - all the fractal gaps in the attractor are filled in by the stochastic process.

    That is to say, replacing chaotic determinism with stochasticity completely negates my arguments about counterfactual incompleteness (associated with states which lie in the fractal gaps in my cosmological invariant set). Hence my arguments about why the violation of statistical independence is explainable in a suitable nonlinear dynamical framework are nullified if determinism is replaced with stochasticity.

    It is for this reason that I am somewhat sceptical of models which attempt to replace real numbers with truncated rationals stochastic noise will work in explaining quantum physics.

    In conclusion, there is a vital difference between chaotic and stochastic dynamics, in my opinion.

    With regards

    Tim

    Tim -

    An exquisite and erudite exposition on matters far beyond my formal training in math and physics (from some decades ago). I gather that you are positing some level of determinism arising from infinite recursion of fractal attractors. In lay terms, if our frame and timeframe are large enough, we can regain the confidence of determinism from the local instability of chaos, just as statistical mechanics rescues us from the chaos of the independent behaviors of individual particles. Am I following this correctly?

    That said, I am dubious that determinism of any sort can be rescued. We can speculate with infinities but we cannot prove anything at all, as the reasoning will always fall short. This verse from the Rubaiyat captures the thought:

    XXIX. Into this Universe, and Why not knowing

    Nor Whence, like Water willy-nilly flowing;

    And out of it, as Wind along the Waste,

    I know not Whither, willy-nilly blowing.

    Thanks - George Gantz, The Door That Has No Key: https://fqxi.org/community/forum/topic/3494

    Dear George

    Thank you for your comment.

    My goal is to formulate a finite theory of quantum physics where the fractal invariant set model of quantum physics is a smooth limit as a parameter of the finite model goes to infinity.

    Finding such smooth limits is highly non-trivial in quantum physics. For example, if you try to discretise the complex Hilbert Space of quantum theory then you violate the Continuity Axiom of Hardy's axioms of quantum theory - and according to his axioms you would revert to classical theory. In this sense quantum theory is the singular and not the smooth limit of a finite discretised theory of Hilbert space as the discretisation goes to zero.

    As Michael Berry has discussed, singular limits are quite commonplace in physics and in some sense represent a discontinuous jump when you go from "very large but finite" to truly infinite.

    What I am trying to do is find a finite theory of quantum physics which has a smooth and not a singular limit as some parameter goes to infinity. In practice I can achieve this by assuming that the symbolic labels associated with the fractal iterates of the invariant set have periodic structure. This is entirely equivalent to the idea that rational numbers have a periodic representation in terms of their decimal expansions. The larger the periodicity the closer they are to irrationals.

    With this I can effectively interpret the invariant set as a finite periodic limit cycle, but with very large periodicity. As discussed (albeit briefly) in the essay, the property of non-computability is then replaced by computational irreducibility. None of the key properties which allow me to reinterpret Bell's theorem are lost in going from strict non-computability to computational irreducibility.

    With regards

    Tim

    Very intriguing essay! The central idea, (which I understood to be) that one might be able to get around Bell's theorem by having aspects of the underlying deterministic theory be uncomputable in a certain precise sense, is very clever. It's much better than a philosophical monstrosity like superdeterminism, too...Still, I admit I did not fully understand all of the technical details. Maybe I will reread it again.

    Here's a philosophical question, though. There's how the universe 'really is', and there's the collection of things we can ever know about it; these sets are almost certainly not equivalent. If there is some sort of deterministic theory that underlies quantum mechanics, but it has the property that it 'looks' probabilistic to us because of uncomputability etc, why should we prefer the deterministic theory? I guess it's possible that ideas like this could help with unification, but it seems to me necessary that the proposed unification would suggest some experiment that would distinguish between the different possibilities in order for that unification to be useful.

    More generally, how can we ever know the 'true' behavior of quantum mechanics, given all these clever alternatives?

    John

    Dear John

    Certainly a new theory of quantum physics should suggest some hopefully experimentally testable differences from quantum theory.

    In the technical paper https://royalsocietypublishing.org/doi/full/10.1098/rspa.2019.0350 on which this essay is based, I present some preliminary ideas on possible differences.

    Thanks

    Tim

    5 days later

    Hi Tim,

    Thank you for writing a very interesting essay! I certainly fell into the category of 'physicist who finds p-adic numbers exotic'. I have never encountered them but am eager to take a bit of a dive into them.

    You certainly raise some very interesting points particularly that undeciability is a property of the underlying state-space of the system and not the physical process occurring in spacetime. Moreover, this lead into a very nice discussion about counterfactuals and free will that I really appreciated.

    If I understand correctly, a non-computable theory can violate the Bell inequality. This uncomputable theory is a based on fractal attractors which correspond to the possible eigenstates of the state space being observed i.e determined by the Hamiltonian?

    It's an interesting paradigm and am eager to read more. Another question I would ask is how does dissipation alter this paradigm? Does it change the state space where the fractal atractors now change to multiple steady state attractors?

    In any case, it was a very thought provoking essay. I hope you have time to take a look at my essay noisy mahcines which considers the limitations of finite resources in undeciable systems.

    Thanks,

    Michael

      Dear Michael

      Thanks for your kind comments.

      Regarding p-adics, I am reminded of a paper I once read by Herman Bondi who said that if children we were taught special relativity in primary school, as adults we would not find things like length contraction and time dilation the least bit strange or unusual. Similarly, I expect, if we were taught p-adic arithmetic in primary school, we would not find p-adic numbers strange or exotic as adults. Peter Scholze, who won the Fields Medal last year, is quoted as saying that he has got so used to p-adics that now he finds the real numbers really strange and exotic!

      Your letter raises a really interesting and important issue - the role of irreversibility. The fractal attractors I am considering have zero volume and hence zero measure relative to the measure of the Euclidean space in which they are embedded. The classical dynamical systems which generate these attractors asymptotically must therefore be irreversible: start with a finite volume and it shrinks to zero asymptotically.

      What is the origin of this irreversibility? In terms of the attractor geometry, the irreversibility could be localised to some small region of state space, such that when the state of the system goes through this region, state-space volumes shrink a bit. In this way, it is possible for the dynamics to be Hamiltonian almost everywhere. But it cannot be strictly Hamiltonian everywhere. It is tempting to suppose that such irreversibility is associated with space-time singularities, but this is merely a conjecture.

      Regarding your essay, I think I am in agreement with your perspective. Although I am claiming that the universe as a whole has these properties of uncomputability, I don't think it makes sense to think of sub-systems of the universe as approximating the properties of the full system in any way at all. In my essay I refer to the inability of the full system to be fully emulated by a sub-system of the full system as Computational Irreducibility - a phrase that I think Stephen Wolfram coined.

      Of course it is worth noting that in many practical cases, noise can and should be treated as a positive resource. Personally, I think human creativity arises because the brain has been able to harness noise in this way - please see:

      https://www.mdpi.com/1099-4300/22/3/281

      Best wishes

      Tim

      Tim, a most sophisticated essay! I can believe that if anyone could accomplish what you've sought, "to provide some basis for believing that these theories [chaos, quantum, and GR] can be brought closer together through the unifying concept of non-computability", you would be the one to do it!

      You are no fool on that errand, but regarding chaos, the dependence of a chaotic system on initial conditions, combined with multiple vectors of recurrent interaction, just makes for a recurring deterministic system that may, as you point out, eventually break out into simple (deterministic) turbulence. So chaos: deterministic but not always computable. Quantum theory: un-deterministic but computable at least as a probability. And General Relativity: deterministic and computable. I'm not optimistic.

      I didn't understand your reason for thinking "there must also be some deterministic framework underpinning quantum physics."

      Finally, more in my wheelhouse, you quote R. Kane "one is free when there are no constraints preventing one from doing as one wishes" - a poor definition that doesn't distinguish between being determined to wish for something and being merely influenced to wish.

      Overall, congratulations on an impressive essay.

      Dear James

      Thanks for your kind comments.

      Regarding free will. Bell's Theorem involves a mathematical assumption called Free Choice. I have proposed a revised definition called Free Choice on the Invariant Set. This basically means you can't choose to do things which are inconsistent with the laws of physics (the laws of physics in my proposed model derive from the fractal geometry of the invariant set). Put like this, I hope you will agree that this is not an unreasonable definition. We don't say that we are not free because we can't flap our arms and fly like birds!

      However, in this definition one cannot predict ahead of time what choices will violate the laws of physics and which will not - this is linked to the non-computability of the invariant set. So, therefore I ask what a more operational definition of free will might be that evades this difficulty. The one I propose is such an operational definition. It's one I personally use in my day-to-day life.

      If there is one real takeaway message from my essay that I hope will resonate with you is that in physics the assumption of rather unrestricted counterfactual definiteness is something that has not been analysed enough. I think this issue should be discussed more in Philosophy of Physics circles. For example, in my essay I give a reason why Lewis's counterfactual theory of causation might be faulty because of an implicit use of Euclidean distance in state space.

      Best wishes

      Tim

        Tim,

        My intuition suggests that Bell theorem could be formulated also as " UUU - mathematical problem" in physics. Hence, there is some so - called "nonclassical tacit math" behind Bell as well?

        Thank you for essay.

        Michael

        Tim, does randomness (defined as something uncaused or unprovoked) defy the laws of physics? It is used regularly in quantum physics to describe the unpredictable. I maintain that it is the best explanation for nothing happening at all. I suggest "spontaneity" as an explanation for anything from the quantum level to human inspiration, which by definition exceeds the laws of physics, but is more credible than nothingness.

        James

        Personally, I have considerable difficulty with the concept of randomness in fundamental physics (even though it is an incredibly useful concept for many areas of applied physics). If you give me a bit string 010010....01 that you claim has been generated randomly, I will give you a deterministic rule for generating that same bit string. Now some might say that randomness is informationally incompressible determinism. Well I would say that in practice the two may well be indistinguishable. However, at a fundamental level the latter is generated by a deterministic rule and the former, presumably, is not. In my view the sooner we get back to thinking about physics deterministically (even though it may be computationally irreducible determinism) the better!!

        Best wishes

        Tim

        This is a really exciting essay; I'm really intrigued by the connections you suggest between quantum mechanics and chaos theory, and am now keen to learn more about this area.

        I did have one general question about the motivation for this approach. If I understand you correctly, the idea is that by constraining the state of the universe to evolve on some uncomputable fractal subset of state space, we get a natural way to violate statistical independence (without the denial of free will) and thus we can have violations of Bell's inequality without violations of locality.I wonder, though, why you consider it important to avoid violations of locality? As I understand it, the similarity of Schrodinger's equation to the Liouville equations leads you to consider underlying deterministic dynamics, and then since Bell's theorem rules out any underlying deterministic local dynamics, you turn to non-computability as a means of violating statistical independence and thus invalidating Bell's theorem. But an alternative possible route would have been to accept the existence of nonlocality and consider how Schrodinger's equation could arise from an underlying deterministic non-local dynamics - is there a specific reason you chose not to go down this route?

        I also have some questions about the sense in which 'locality' is preserved by your model. First, consider applying the constraint of evolution on a fractal subset to an indeterministic model. Then if the evolution of the universe is constrained to remain on the fractal subset, it would seem that the (non-deterministic) evolution of the universe at any one spacetime point must depend on the (non-deterministic) evolution of the universe at all points spacelike related to that point, as if the points evolved independently and non-deterministically then it would be possible to go off the fractal subset. So constraining the universe to lie on the fractal subset does not, in the absence of determinism, seem to give us a local theory. So now consider a deterministic model as you propose. Here the evolution of the universe is fully determined by the initial state (I am assuming here that by 'deterministic' you are referring to initial-value determinism, as the term is commonly used), and so the constraint you suggest comes down to requiring that the universe has a fine-tuned initial state which ensures that its evolution always remains on the fractal subset. But surely if this sort of fine-tuning is allowed then we can quite easily explain nonlocality without needing to appeal to noncomputability or fractal subspaces - i.e. we can encode the choices of measurements and the measurement results for all Bell experiments which will ever be performed directly into the initial state, and thus produce experimental results which appear non-local even though they are in fact produced from local evolution from this fine-tuned initial state. I think most physicists are not keen to adopt this approach to eliminating nonlocality because it seems unreasonably conspiratorial and fine-tuned - do you think your fractal approach gets round this complaint in some way, and if so, how?

        I was also interested in the approach you take to recovering 'free will.' The distinction you make between defining free will via counterfactuals vs defining free will as the absence of constraint clearly ties into long-standing arguments in philosophy about the nature of free will, and I think there are indeed good arguments in favour of the latter approach even before one comes to the specific theoretical model that you introduce here - indeed I would be fascinated to read a paper discussing the links between your proposal and the body of philosophical literature on this topic!