I was going through John Rennie's answer and I had a issue in understanding it.
So if my understanding were to be right. The universe were to be a grid and scaled at different points in time, that would mean that 7 billion years after the big bang (about halfway back), the distance between atoms were half the length they are today.
So if I were to just change the unit length of the grid (by hypothetically moving to a different time), I would be larger/smaller than my present self which would offset the apparent moving away of the galaxies.
In other words, changing the spacing is like zooming into a group photograph (or zooming out). If I were to zoom into myself in the photograph, I become bigger on the screen that also results in my sister who was standing next to me in the photograph move away from me (in terms of pixels on my screen). But while this is all happening, I were to go inside the conscience of my 'image self', I have become bigger than I was before that means that my perception of length has also changed (my eyes also become bigger so hence the standard meter that my image self knows about has increased) which then means that I haven't noticed the change at all.
Doesn't the same go for galaxies? I zoom into 1 galaxy but since the universe is scaling (not growing), our definition of length itself changes, the speed of light increases, all in a way that we don't even notice that the universe is growing.