Math is the only one who can define "1 + 1 = 2" is correct and "1 + 1 = 3" is wrong. Math can even define it both correct and wrong to have more than one parallel lines, depending on the system.
You can not do that in physics. You can't define it's correct (or wrong) for things to fall down to earth. You can't even define it's wrong for time to flow backwards.