I think it might have to do with something Einstein showed: that regular physics works well for everyday situations, because they are not at extreme speeds, but at higher speeds, our physics breaks down. "Everday situations" seem to have persisted until we developed means of shooting things into space, but might it be the case that more holistically thinking individuals in the future will have an easy hold on the topics of space-time and relativity?
The crux of the matter is that all measurement / observation of time is dependent on matter (or light) interacting with matter (or light) in a different location. Plus we have measured that the interaction between particles itself happens at a certain speed. This means that whether the observer and the observed are separated by space (being in different locations at the same time) or time (being in the same location at different times) they need interaction to establish any relation. So you could visualize space and time as just two dimensions of interaction. Imagine that basically at each moment as much as you are interacting with space and choosing to engage with matter located to the left or to the right, you are also interacting with time by choosing your SPEED of engaging with matter. And as much as we are limited by physical possibilities in acting towards matter, so is there a limitation in choosing the time/speed.
Space cannot be measured without interacting also in two separate time points and time cannot be measured without interacting also in two separate spatial points.
I am under the impression that mystics, yogi, buddhists and magicians have reached these impressions by practices of meditation and mind control, where it easily becomes apparent that the whole sensation of time and space is dependent on the interaction with matter outside the body and also the state of mind, which can also be described as matter/light interacting, neurochemically.