Hi Florin,
I wrote: "That is, just as yours asks 'What behaviors exist in reality that cannot be accounted for using mathematics?' perhaps this heuristic could ask 'What behaviors cannot be accounted for in mathematics that _can_ be accounted for using computation?'
You replied: "I think the answer to this is more or less settled mathematically by the Church-Turing thesis. While not really proved, no acceptable counter examples were found so far. So unless we either have a proof for this or a valid counterexample, there is nothing NEW to be said here."
First, I need to admit to a poor choice of words. "Accounted for" makes my question sound very stark and either-or, like it pertains to whether there are differences between mathematics' and computation's _technical_ability_ to handle certain behaviors _at_all_. Of course Church-Turing establishes there are no such differences. I should have phrased the question more along these (admittedly more qualitative) lines: "Are there any behaviors that can be symbolically modeled -- naturally/gracefully manipulated -- using computation, that can only be crudely or partially treated by mathematics?" This is more the perspective on conditional branching, if/then/else statements, that I was trying to highlight.
I readily concede that conditional branching _can_ be effectively expressed in mathematics, but in so doing it loses some of the fluidity and ease of access from human thought processes that it would otherwise enjoy if expressed in computational terms (i.e. source code).
So, that clarification might ring true for you, or it might just sound like me making a mountain out of a molehill; but in any case, the time has come to say some more general things about the Church-Turing thesis.
As you point out, the Church-Turing thesis is a thesis, not a theorem. It has yet to be proved, despite its near-universal acceptance. You say "there is nothing new to be said" about it unless one either provides a proof or a valid counterexample. Just for sake of argument, let's imagine that someone does come along and provide a proof, and after a few years, the peer-review community agrees: it's now the Church-Turing Theorem.
This might be a watershed event for computer science, but I predict it would be of surprisingly little consequence in the digital physics community. This is because, as formally stated, the Church-Turing thesis concerns itself solely with algorithms that terminate. The eternal expansion called for by the Lambda-CDM model of cosmology would nudge one -- if one were already predisposed to thinking of the universe in computational terms -- in the direction of a nonterminating procedure; hence one that owes nothing (or, at least, owes a frankly unknown amount) to Church-Turing. And remember, that's even if Church-Turing is promoted to Theorem. In its current thesistic state, the fealty is even weaker.
The other point I'd like to make is best conveyed through a metaphor (that I promise will be less strange than the "computation-as-beast-of-burden" one!). Imagine that the science of biology had an entirely different history from its actual one -- all the same observations and discoveries, but made drastically out of order compared to its real history. In this parallel biologisphere, the existence of DNA was among the very first discoveries made, before such basics as symbiosis, photosynthesis, or even evolution itself. This alternate science of biology is ruled by the Crick-Watson Thesis, which states that all organisms, by virtue of using DNA to encode the totality of their features, are just instances of Universal Watson Machines. Participants in this sort of biology would have trouble understanding why someone like Darwin would want to spend years in godforsaken hellholes studying birds and turtles up close, because they would already "know" -- already have "proved" -- thanks to the Crick-Watson Thesis, that every organism is isomorphic to every other organism. In a sense, there is only one organism -- the UWM -- and what we would normally think of as "species" are simply specific constructions of UWM, perhaps different from other UWMs in some superficial or toylike way, but at bottom, in any deep sense, exactly the same as every other UWM.
Do you see where I am heading with this analogy? To me there is an entire vibrant "biosphere" of computational entities, just as real as any biological species you care to name -- yet those higher-level computational constructions are not being explored with the optimal combination of rigor and enthusiasm, because everybody keeps tripping over the Church-Turing thesis. The Church-Turing thesis should be viewed as a starting point for higher-level exploration of ever more refined forms, not just an excuse to avoid asking deeper questions. This, in a sense, is the _real_ halting problem: the presumed truth of C-T causing computer scientists themselves to halt.
Back in real-world biology, the recent progress made in epigenetics seems to bear this analogy out to a certain extent -- it turned out that even the Crick-Watson Thesis, while correct, was incomplete. DNA-level isomorphism can conceal higher-level heterogeneity that has heretofore remained hidden. Epigenetics is slowly opening our eyes to an entirely new world of higher-level structural refinement in biology. The same thing is urgently needed in computer science; the closest equivalent to such study is "design patterns," but that has problems of its own (mainly a lack of scientific rigor and symbolic manipulability).
If possible computational architectures that could produce an eternally inflating discrete fractal cosmos are to be constructed and studied, the Church-Turing thesis is simply not the most relevant or useful tool for the job. That is not meant to be construed as a full-bore attack against C-T or a statement that it is completely valueless or somehow "wrong"; just that the insights it provides do not appreciably benefit this particular problem domain.
Thanks for your time,
Owen