I would prefer to say that mathematics is a set of numbers for the principle available physics theories, relativity and quantum mechanics, have reality interpretations that are vastly different.

Quantum mechanics can be interpretated as wave-only or particle-only or multiple universes, or pilot waves, etc. Relativity can have mass distorting geometry with no gravitational fields or flat geometry with gravitational waves and particles. So the basic equations of physics can be derived from a set of numbers, but they still do not tell us if there are particles or waves or gravitational fields. They do not tell us what reality is, only what we can know about it.