In our publications we have proposed an approach called finite quantum theory (FQT) when quantum theory is based not on complex numbers but on finite mathematics. We have proved that FQT is more general than standard quantum theory because the latter is a special degenerate case of the former in the formal limit $p\to\infty$ where $p$ is the characteristic of the ring or field in finite mathematics. Moreover, finite mathematics itself is more general than classical mathematics (involving the notions of infinitely small/large and continuity) because the latter is a special degenerate case of the former in the same limit. {\bf As a consequence, mathematics describing nature at the most fundamental level involves only a finite number of numbers while the notions of limit and infinitely small/large and the notions constructed from them (e.g. continuity, derivative and integral) are needed only in calculations describing nature approximately}. However, physicists typically are reluctant to accept those results although they are natural and simple. We argue without formulas that there is a simple analogy between the above facts and the fact that special relativity is more general than nonrelativistic mechanics because the latter is a special degenerate case of the former in the formal limit $c\to\infty$.