Modern science is the most complicated theoretical structure ever created by mankind (and possibly by any living species in our Universe). This is particularly true in modern physics which represents the most mature and elaborate branch of modern science. Nevertheless, modern science (and physics in particular) seems to make itself more complicated than necessary, and sometimes modern science seems to make itself complicated unnecessarily. This "simplistic" view to science may be supported by the fact that Nature (despite our acknowledgment of its complexity and sophistication at the level of fine details) seems to be governed by some rather simple rules and general laws which may be able (if comprehended and employed correctly) to make our science much simpler than what we actually have. In this article we try to highlight some issues about potential simplification of modern science (and physics in particular) which (i.e. simplification) could be one of the greatest goals and advancements (if achieved) of future science. In our view, the simplification of science is fundamentally related to the issue of unification of physics and the search for the so-called "theory of everything" (i.e. in a sense different to what is currently perceived and envisaged).