\"It from bit\" and the quantum probability rule by Matthew Saul Leifer

Dear George,

There are a lot of interesting essays to read and unfortunately I do not have time to read all of them. I hope you will understand that I cannot guarantee to read someone's essay just because they mention it here. If the abstract looks interesting to me then I will read it and rate it.

This thread is supposed to be for comments about my essay, so if you have something specific to say about it then I would be glad to respond.

Regarding Jaynes, I made some less than sympathetic comments about the Cox approach to probability in my response to D'Ariano and of course Jaynes relies on that approach as his foundation. As with Cox, I find Jaynes a little too simple minded for my taste, as he ducks some major issues with the choice of prior and makes too many arguments based on simplicity. Of course, Jaynes was working in a time when Bayesian methodology was disavowed by the vast majority of statisticians and scientists, so he has to be read in context. He was mainly concerned with Bayesian statistics as a practical tool that could give greater insight than classical statistics and with ways of rendering the theory practical in a time before computer simulation was available. In this he succeeded admirably. In those days, the two issues of how we should think about probability and whether we should adopt Bayesian or classical statistics were often conflated. Now that Bayesian statistics has a large community of supporters, we can afford to think more carefully about the former problem, and I think we would do better to move beyond the Jaynes-Cox maxent dogma. I should note that the subjective approach I favour predates Jaynes by several decades, but its founders were a bit more careful about conceptual issues.

``One question I'd like to ask is "where one starts" to interpret QM. For example in an earlier essay, I 'derive' Born probability for the wave function from the partition function. In your mind is this a legitimate starting place, or must one go all the way back to tossing coins (or placing bets)? As you note, "there's nothing in logic that tells you what premises you have to start with."''

If you want to come up with a fullblown interpretation of quantum theory then I think you need to start from a well-defined ontology. You need to say what things would exist in reality if quantum theory were literally true. This sounds like a realist position and it is naturally interpreted that way, but it would be OK by me if you want to say that the only things that exist are measurement outcomes or something along those lines, so long as you have started from a clear statement to that effect and deal with the conceptual problems entailed by that. You need to start from such a clear statement if you want to derive the quantum probability rule because you need to say what the quantum probabilities are probabilities of. Depending on your choice, it may be that you do not need to view quantum probabilities as constituting a different theory from classical probability, so you may not need to go all the way down to the foundations of probability. For example, it is like this in Bohmian mechanics where the probabilities are just ordinary classical probabilities similar to those of statistical mechanics.

If you don't start from a clear statement about reality then deriving the Born rule becomes a mathematical game with no clear conceptual meaning and of course there are already a lot of formal mathematical reasons for adopting the Born rule.

On the other hand, it may be that you are happy not to have a fullblown interpretation of quantum theory at the moment but still think that some argument you have come up with is suggestive as a way to proceed. Most of the best work on the foundations of quantum theory is probably going to be like that until we are lucky enough to hit on the right ideas. Therefore, suggestive arguments are fine with me so long as you are honest about their status.

Regarding noncontextuality, there are two senses of this word in quantum theory, which can cause some confusion. I am using it in the sense of "noncontextual probability assignment", which simply means that the same projector receives the same probability regardless of which measurement that includes it is made. There is also the sense of "noncontextual hidden variable theory", which is ruled out by Kochen-Specker and related results. Some people say that the impossibility of a noncontextual hidden variable theory should be shortened to "quantum theory is contextual" in the same way that we say "quantum theory is nonlocal" as a shorthand for the implications of Bell's theorem. This leaves us with the awkward statement "quantum theory is contextual, but it has noncontextual probability assignments", but in fact I think this is a rather good way of stating what the central puzzle of this area is. If the world really is described by a contextual theory then it is very puzzling that the quantum probabilities are noncontextual. If you just put an arbitrary probability distribution over a set of contextual states then generically you would get contextual probability assignments. Therefore, a fine tuning would be required to get exactly the quantum probability rule. This is similar to the fine tuning required to prevent signalling if the word is really described by a nonlocal hidden variable theory. The fine tuning is the real issue and what it indicates to me is that we need to look for an alternative kind of ontology to which the fine tuning does not apply.

I haven't read Gordon's essay, but I have rather had my fill of skepticism about Bell's theorem this year and the way you describe it does not sound promising. We can already write Bell's theorem in terms of sums rather than integrals once we realize that the case of a stochastic hidden variable theory can be reduced to that of a deterministic one by convexity. Once we have done that, we then realize that the only thing that matters about the hidden variables for the purposes of the argument is what measurement results they predict. Since there are only a finite number of lists of possible measurement outcomes for most Bell inequality setups we are at this point dealing with finite sets so we already have sums rather than integrals. This cannot possibly be the place where things go wrong.

Of course, there are still ways around Bell's theorem that involve questioning the basic setup rather than the mathematical result itself. I think it is here where we will find the solution. Like Ken Wharton and Huw Price, I am rather partial to the idea that retrocausal theories should be investigated, but there are other possibilities.

"Your remarks about Ken's approach surprise me. Perhaps I should re-read your exchange with him."

Well, I am critical not because I believe that his models are a bad idea, but because I believe that the conceptual framework needs to be developed more carefully. After all, there are ways of writing down classical theories that make them look like they involve weird causality, such as the Wheeler-Feynman absorber theory, but we know in that case that there are alternative ways of writing things down that have conventional causality. Therefore, it is not enough to say "look, I have derived a model starting from a block picture of spacetime". One also has to prove that there are obstacles to understanding the theory in any other way. To achieve this we need an analysis of the possibilities for such models at least as rigorous as Bell's analysis of theories with conventional causality. For this reason, I am putting his work in the "suggestive argument" category for now and, as I said, there is nothing wrong with being in that category.

"I'm not sure whether you answered the question as to whether non-locality would be obvious had Bell never invented his inequality. If you'd care to clarify it, I'm still interested."

Sorry, I didn't realize that this was one of your questions. My answer is a definitive no. Without Bell's analysis I think the EPR reasoning would stand (or better Einstein's earlier arguments which are less confusingly tied up with the uncertainty principle) and the best response would have been to look for a local hidden variable theory. In fact, I think there are only a few results that point to fundamental difficulties in interpreting quantum theory. These are:

- Bell's theorem

- Contextuality (This starts with Kochen-Specker, but I prefer Spekkens' more general definition)

- Results about the reality of the wavefunction (PBR theorem et. al.)

- Excess baggage theorems (results about how the size of the ontic state space must scale exponentially with the number of systems)

Each one of these theorems points to an explanatory gap. Namely,

- Ontological models must be nonlocal, but they must also be nonsignalling.

- Ontological models must be contextual, but the probabilities must be noncontextual.

- Ontological models must have the wavefunction as part of their ontology, but many quantum phenomena are most naturally interpreted in terms of an epistemic wavefunction.

- n qubits must carry O(2^n) bits of information, but on any way you define the operational information content of n qubits it comes out as O(n) bits.

All other phenomena that I know of can be modelled quite straightforwardly so long as one does not stick to the dogma that reality must be described by particles travelling along definite trajectories. This is why I am not impressed by arguments based on basic interferometry experiments like the double slit.

What the explanatory gaps indicate to me is that there is something wrong with our basic framework for realist models of quantum theory. The right framework, whether that involves retrocausality or some other exotic thing, should close all these gaps, e.g. it should reveal that quantum theory is not nonlocal after all and similarly for the other gaps.

This discussion thread is supposed to be about my essay. I am happy for people to talk about their own essays provided this is done in the context of commenting on something specific that I have said in my essay, or something specific that has come up in the subsequent discussion. If you want to make a comparison between something you have said in your essay and something I said in mine then that is perfectly fine, especially if you do so in order to raise a specific question that we can then go on to discuss.

Posts that are essentially just a summary of your own essay and/or a request for me to read your essay are against the FQXi terms of use http://fqxi.org/community/forum/intro#terms which state that posts should not be outside the scope of the forum topic.

I do not mean to offend anyone. It is obviously a judgement call as to whether or not a particular post contains substantive comment on my essay and the subsequent discussion, but I will report posts that seem inappropriate to me. It is then up to FQXi to decide whether or not they are appropriate.

Finally, let me reiterate that I cannot read all the essays but I will read those that I think look interesting. I will do this primarily based on reading the abstracts of the essays. Posting a summary of your essay here will not make me more likely to read it.

Within the context of the essay, there are two possible positions that make sense to me. One could be completely operational about things and say that the only things that exist are the readings on our experimental apparatus, e.g. detector clicks, instrument readings and so forth. In that case, we are assuming that our macroscopic apparatus exist, but not that there is necessarily any deeper reality underlying them. However, the position that I prefer is to assume that there are things called quantum systems that exist independently of us and we are just asking questions about the properties of those systems. In that sense, I am assuming that "it" in the sense of "a quantum system" exists and is not being questioned.

Of course, one can also consider situations in which you are not sure whether a particular quantum system exists, e.g. a laser typically emits a superposition of different numbers of photons. In that case, it sometimes makes sense to include a question about whether the system exists if you can ask it without destroying the system. For example, there are heralded single photon sources that produce two photons in an entangled state and then one can use a measurement on the first photon as evidence that the second photon exists.

I hope that answers your question, but of course it depends on precisely what you mean by IT.

Thanks for your kind comments about my essay.

It is important to distinguish two things:

1) Believing in the subjective Bayesian interpretation of quantum theory and wanting to employ it in understanding the probabilities that arise in quantum theory.

2) Being a QBist, i.e. believing in what Caves, Fuchs and Schack have called quantum Bayesianism.

Quantum Bayesianism, or QBism, is a very specific work-in-progress interpretation of quantum theory, in the category that I call neo-Copenhagen. It employs a subjective Bayesian interpretation of probabilities, but goes way beyond that in denying the existence of a deeper reality underlying quantum theory.

In contrast, just believing in subjective Bayesian probability does not imply any of that. As I mentioned in the essay, you can apply it in the many-worlds interpretation, and it would also be unproblematic in Bohmian mechanics, at least if the probabilities statistical mechanics can be interpreted subjectively because they are of the same type.

My view is quite far from QBism because it ends up accepting realism of a fairly straightforward type. Fuchs and company are dead against this. It is rather unfortunate that they have co-opted the phrase "quantum Bayesianism" to refer to their approach, since by rights that should refer to any attempt to apply Bayesian probability and statistical methodology to quantum theory. As it happens, I did obtain my first exposure to Bayesian probability from Fuchs et. al. I am very grateful for that and probably would not be doing quantum foundations were it not for Fuchs' eloquent papers and talks, but my view is definitely not a form of QBism. If my view gains more acceptance than QBism then I would be happy about that, but I doubt it would please the QBists.

You are right that the next step is to try and construct an ontology in which noncontextuality emerges naturally. This is not true in Bohmian mechanics for example, since a generic probability distribution over the positions of particles would be contextual. The reason that I mentioned many-worlds in the essay is that I believe that the Deutsch-Wallace argument does achieve noncontextuality naturally. However, this is not too surprising because they assume the objective existence of the wavefunction and only the wavefunction, and this is the thing that encodes all the information about the quantum probabilities in the first place. As a proponent of the epistemic interpretation of the wavefunction this would not be where I would start. Instead, I would look at more exotic single-world ontologies than are usually encountered in the literature, such as those involving retrocausality.

Finally, regarding reading on the foundations of probability, I wrote a blog post with a reading list some time ago http://mattleifer.info/2010/11/01/a-reading-list-on-the-foundations-of-probability-and-statistics/ I update it periodically with mini reviews as I read things, but I haven't done so for some time meaning that I have now read a lot of the things marked UNREAD. For the philosophy of probability, I would recommend starting with Donald Gilles' textbook and then the collection of essays edited by Anthony Eagle. The former is the best overview, but is not perfect and is lacking in coverage of many contemporary issues. The latter remedies this as well as containing many of the classic papers.