Dear Noson Yanofsky,
I enjoyed your essay, and found fascinating the idea of thinking of octonions as fundamental and all other number systems as subsets of the octonions. I very much like your statement: "All the axioms that one wants satisfied are found "sitting inside" the octonions."
You rightly focus on symmetry in physics. While much of particle physics is based on symmetry [such as SU(3)xSU(2)xU(1)] these are not 'exact' symmetries in that the masses of the particles are not equal. In fact, approximate symmetries are applied to cases where one mass is almost 100 times greater than another. Yet these approximate symmetries still yield results.
I believe your key point is that physicists act like a sieve and significantly constrain the class of problems they tackle, limiting themselves for the most part to predictable regularities. At the end of your first paragraph you ask "What exactly are these laws of nature and how do we find them?"
In my reference 5 (The Automatic Theory of Physics) I design a robot physicist to derive theories (models) of physics from observational data. The general approach, group the numbers via inter-set and intra-set distances to derive feature vectors, is summarized in my endnotes. Thirty years later Schmidt and Lipson applied this theory via pattern recognition algorithms to
"automatically search motion tracking data captured from various physical systems..."
Whereas I had treated little more complicated than trajectories of rocks, etc, Schmidt and Lipson treated complex systems such as weights on springs and the double pendulum. In other words, systems with predictable regularity as you note. Based on their pattern recognizing robot they found:
"Without any prior knowledge about physics, kinematics, or geometry, [the robot] discovered Hamiltonian's, Lagrangians, and other laws of geometric and momentum conservation."
This agreed with my theory. However what I found most fascinating was that they found the 'type' of law that the robot derived was determined by what variables were presented to the robot observer. They discovered:
"... if we only provide position coordinates, the algorithm is forced to converge on a manifold equation of the system's state space. If we provide velocities, the algorithm is biased to find energy laws. If we additionally supply accelerations the algorithm is biased to find force identities and equations of motion."
Especially with regard to your question, 'how do we find these laws' I hope you find this as interesting as I do.
My very best regards,
Edwin Eugene Klingman