Flavio, whether interpretation is at the core of science is debatable. I agree with you. I think it is our explanatory frameworks that let us make sense of the world, whether true or not -and science is about (or at least in my opinion should be about) understanding not just data collection and calculation. Mathematics in physics seems to be elevated in importance in contrast to your view, as mere aesthetics. I think its place is somewhere in between. A theory should be able to be represented with mathematics, which as well possible utility allows another kind of evaluation. Gedanken experiments also help convey ideas and can provide check-able mathematics.
Re. Using observation as "the ultimate judge of the truth of an idea" (as you say). It does not work for Relativity because the error is in the a priori structure used to evaluate the results. What is being investigated is already assumed as causal and not consequence of what has happened to the EM signals. An example: Gravity probe B (operational 2004-11.) Testing " 1) the geodetic effect--the amount by which the Earth warps the local spacetime in which it resides; and 2) the frame-dragging effect--the amount by which the rotating Earth drags its local spacetime around with it." NASA, Gravity probe B in a nutshell, Nasa.gov pdf. Predictions of the theory confirmed. Though the predictions are confirmed it does not mean the spacetime explanatory construct is correct. The effects on the signals received by the telescopes can appear to corroborate external spacetime curvature, Yet the apparent spacetime is the consequence of what has happened to the light and not cause of the effect. Observation is not in this case the ultimate judge of truth. It is unintentionally deceptive.
Which is to make my point that, in a way, to emphasize experimentation over all other kinds of evaluation is also another kind of bias. Re pretty statements... to be science they must be scrutable and vulnerable to disproof in some way, not necessarily by experiment. Self consistent but irrefutable statements are not in themselves science but an explanatory framework may require some philosophical foundations that are accepted as necessary for comprehension.
This is just meant as food for thought. Not in any way as a disrespect for the views expressed or the devaluation of the essay. Kind regards Georgina