How can we look into the past?
Light has a fixed velocity of almost 300.000 meters per second. Sunlight takes about 8 minutes to reach us. So we see the sun always 8 minutes ago.
As the other answer says, stars are much further away and it takes light that much longer to reach us.
How do we know how far away the stars are? There are various methods that clever astronomers have found to measure this distance.
Once we know the distance we know the time that light left that star, so a time "map" of the constelations can be made.
Does this mean that we might be able to see ourselves even?
Not even as a hypothesis, as you are here, not on a star distance to be radiating light towards the earth.