Dear Mauro--
This is a very significant and thought-provoking article, even though I find some of its claims a bit unqualified. But then, their uncompromising character gives force to your argument, too. One cannot really do the article justice, apart from writing a full-fledge, article-length response to it. Let me, however, venture a few comments of both historical and conceptual nature.
I do agree that your argument has affinities with structural realism, but I shall not address these affinities here, except for noting that your claims are stronger than most made by structural realists (there are other differences as well). Historically, I find your argument close to Heisenberg's later views, when his views become closer to those of Einstein from the late 1920s on (after his work of general relativity, as grounded in Riemann's geometry, and during his work on the unified field theory), rather than to those of Bohr, whom Heisenberg followed initially. At this point, Heisenberg was also influenced by Dirac, whose views were in turn close to that of Einstein in the late 1920s. Cf., such famous pronouncements as "the laws of physics must have mathematical beauty," although this is Dirac's, or Einstein's, deeper thinking on these matters that is important here. I do agree with you that it is not beauty of mathematics, but mathematics itself, sometimes as the mathematics of beauty, that is crucial. Heisenberg also expressly linked his view to Plato: "If we wish to compare the finding of contemporary particle physics with any earlier philosophy, it can only be with the philosophy of Plato; for the particles of present-day physics are representations of symmetry groups, so the quantum theory tells is, and to that extend they resemble the symmetrical bodies of the Platonic view" ("What is an Elementary Particle?" Encounters with Einstein, p. 83). At one point, Heisenberg goes as far as claiming that from the viewpoint of modern quantum physics, Kant's things-in-themselves are mathematical.
That said, however, there is also a continuity with Heisenberg's and, especially, Dirac's earlier views, based in the physical principles. What they maintained, however, was that such principles must necessarily have their mathematical expression, which why Dirac realized a crucial role of noncommutativity so quickly and so deeply (quicker and more deeply than anything else, including Heisenberg, who had his doubt about it). All of Dirac's work may be seen as dedicated to the task of finding the mathematica expression for his principles, and in this sense is deeply mathematical, which is not quite the same as but is a link to the type of argument your advance here. Also, its mathematical nature is not equivalent to doing mathematics (there is an interesting contrast to Von Neumann here). It may indeed be that the disciplinary mathematics is not mathematical enough for physics, which more deeply mathematical than mathematics. Plato argues a similar case for philosophy, which he thought should be more mathematical than mathematics, as a disciplinary practice. In this, it may be less important to be a good mathematician that a truly mathematical physicist, which is to easy, however.
My main point at the moment is that your reversal of Dirac's earlier view, that is, your argument to the effect that these are in fact mathematical principles that must be given physical expressions, is nevertheless both a continuation of and a break from Dirac's program. An important article!
Arkady Plotnitsky