I have a strong evolutionary standpoint on mathematics. I consider mathematics to be nothing more than a communication product of the evolution of human brains, which means that understanding mathematics first boils down to understanding human brains.
I speculate that brains started with the macroscopic multicellular organism's need to move around its environment to reach better living conditions. To this mean, it developed a motor nervous system to innervate muscles for contraction. It then developed a variety of sensory systems, feedback mechanisms that, once appropriately engineered and linked to the motor component, enabled movement adaptability to the changing surrounding environments.
I'd argue that ever since the sensorimotor system has been developed, the brain's evolutionary challenge has been to determine what is the sensorimotor algorithm that provides the best chances of survival (say, for a given species in a given environment). We started with nervous arc reflexes (motor and sensory neurons); we then developed more sophisticated neural computations that required more and more interneurons to process the computing steps between the motor and sensory neurons.
As our brains evolved in an environment to which they were sensitive, they were exposed to recurring sensory patterns of "physical phenomena" and their evolution was shaped by conserving the neural organizations that most accurately predicted these "physical phenomena" for the largest number of contextual sensory inputs. These neural organizations were the rudiments of logical reasoning.
This means that human logical reasoning has been shaped based on the "physical laws" that seem to permeate our external world. This explains why a Cro-Magnon individual could mentally calculate the angle and force that would throw his spear to hit its target: its brain had internalized the physical laws of ballistics to which it had been repeatedly exposed to. This was way before mathematics was developed. Then, one day, some individuals started transcribing on paper these principles of logical reasoning in their best possible accuracy, and this was the birth of mathematics.
Mathematics is thus not an invented science nor a discovered science. It is a means of communication of logical arguments between individuals. It is the human logical reasoning system externalized into a universal language.
From then on, things started speeding up. Logical reasoning segments could be communicated with great speed and efficacy between individuals, and soon a whole community could work on the same logical reasoning problems that in the past, individuals had been trying to solve alone. This increase in total computing resources enabled human beings to solve more and more complex logical reasoning problems, which, because the logical system was tailored to reflect the macroscopical physical world that had surrounded our brains throughout their evolution, were proved to be very useful in the macroscopic world. Protocols of conduct were elaborated on the basis of this successful reasoning system, one of which was the scientific method, which has led us to the kind of science we know today.
As said earlier, mathematics has proven to be very useful at understanding macroscopical physical problems (e.g. problems in Newtonian mechanics), which also seem intuitive to "understand" to the human brain. However, we must keep in mind that mathematics is actually a reflection of our logical system, which was designed to work in a macroscopical physical environment. When we try to use mathematics to describe the physical world at different levels, i.e. at the microscopic scale, the nanoscale, or the cosmologic scale, things get tougher and we find ourselves with logical conclusions that seem more and more unintuitive and even far-fetched. I think this is because our logical system is not adequate to describe the external world on such scales.
Therefore, I think that, like any other evolutionary tool, mathematics may very well have use limitations, especially when used to describe physics in the non-macroscopic scales. Things in mathematics that are not physically conceivable, such as the concepts of a point or of infinity, are not a problem for me, as I see these as simply some of the basic concepts that our logical system uses to base its operations on.
The question is, will this logical reasoning system be sufficient to enable us to describe, within this system, the physical phenomena on all possible scales? It may or may not be, but I think that the most likely scenario will be that living beings will eventually use a superimposition of many evolutionary tools (some of which may not yet be developed) at once to solve complex problems of description such as the ones we currently encounter in quantum physics and cosmology.
I haven't specified why I put some words in quotes, nor have I touched on other topics, esp. truth (I think there is no absolute, Platonic truth, and that our tendency to relentlessly search for one truth is part of our pre-programmed logical reasoning system), but if you are interested I would be glad to share these thoughts too. I would be very curious to hear about your opinions on my evolutionary pure speculation!