Well, I am sorry but this is incorrect (that new theories "throw away" old ones. Say, the Earth is still flat if you take small area of it, space-time is still rather Euclidian in small volume (Solar system), Newton's laws are still there being highly accurate at small velocities, etc etc. This is the essence of a science: we make theories more amd more accurate by observing facts in broader and broader range. And, as you may notice indeed, since Pithagorean time it was found that the Universe is pure mathematical. Actually even way before that. And the reason that Universe strictly obeys mathematical equations (Newton, Einstein, Maxwell, Shroedinger) without single exeption is simple fact that math originates from exactly the same fundamental principle the Universe strictly obeys: any object/phenomena in it can either exist (we agreed to call it 1 in math) or not exist (we call it 0) but not both. Algebra follows from arithmetic, calculus from algebra, differential/integral equations from calculus. So all equations of physics are actually mathematical identities of the fact that nothing in the Universe can be in the state of existence AND inexistence at the same time.

No wonder, all stuff in the Universe [including our brains' fantasies about god(s)]strictly follows these equations. Moreover, if certain equation has several solutions, there are SEVERAL phenomena in the Universe (say, the equation of free fall is quadraic, therefore it should have TWO solutions: TWO moments of time for a free-falling rock to hit the ground. It may sound as a paradox but it indeed is TRUE - the rock hit the ground not once but TWICE (once in positive moment of time and in once in negative). If there is no solution, there is NO corresponding phenomena in the Universe (say, Einstein equatios have NO static solution - free rock can not hover in space, it HAS to move).

And, by the way, "allmighty God" can not affect motion of a rock - not a millimiter, not even a micron. Nor can he affect behaviour of a single electron, not to say about more complex systems. But knowing math you can predict it to extremely high degree of accuracy, and THUS affect it (build computers, cell phones, laser players, cars, space probes, etc.).

When you are seriousely sick, do you go to doctor or do you pray? Why do you go to doctor then? Just keep praying more. It does not work, uh? Well, then you have to use genetically engineered pills, vaccines, x-rays, computer tomography, bypass surgery, radiation therapy, laser surgery -all this "mathematical" stuff. Why? Cause it works. Guess, where would you be without it,(or if you just kept praying)? I thing, you already know where - up in the heaven.