It's not only our own light pollution that restricts our view.
Light pollution is an atmospheric condition, or at least contributes to it - it is such conditions that affect the clarity of an image produced by a telescope, considering the light from stars must make its way through the entire atmosphere to reach our mirrors on the surface, and it's disturbances in the air that cause distorted or blurry images - the condition is termed astronomical seeing:
Astronomical seeing refers to the blurring and twinkling of
astronomical objects such as stars caused by turbulent mixing in the
Earth's atmosphere varying the optical refractive index. The
astronomical seeing conditions on a given night at a given location
describe how much the Earth's atmosphere perturbs the images of stars
as seen through a telescope.
This basically means that if the air is calm and tranquil, then the seeing is good and stars and whatnot can be observed with a steady light. Whereas if the air were to be turbulent and tempestuous, then the seeing would be bad and stars can could be observed to twinkle.
There is something known as the maximum useful magnification which dictates that power of magnification cannot be indefinitely increased. Each telescope has a practical limit of useful magnification, any further magnification after that won't expose any more underlying detail but will simply magnify the blurring caused by bad seeing or diffraction - to my knowledge this limit is about two times a telescopes aperture in inches. So, for a four inch telescope the limit would be around X200, and X400 for an eight inch.
Space telescopes obviously have the privilege of being removed from the interference of Earth's atmospheric conditions and so these can see much farther and with finer, sharper detail.
Naturally, 'if there would be no atmospheric distortion' then we could see better, too.