The SI system has 4 base units: length (m), time (s), mass (kg) and current (ampere). All mechanical measurements can be expressed as a combination of the 4 base units. For example, energy $\rightarrow{\rm kg\ m^{-2}\ s^{-2}}$ and electric charge $\rightarrow {\rm A\ s}$.
The Gaussian system has 3 base units: length (cm), time (s), mass (g). All mechanical measurements can be expressed a combination of these 3 base units. For example, energy $\rightarrow {\rm g\ cm^{-2}\ s^{-2}}$, electric charge $\rightarrow {\rm g^{1\over 2}\ cm^{3\over 2}\ s^{-1}}$ and current $\rightarrow {\rm g^{1\over 2}\ cm^{3\over 2}\ s^{-2}}$.
Note the awkwardness of the base unit ampere in the SI system. This is one of the reason why physicists prefer the Gaussian system while engineers prefer the SI system.
How the SI System Came About
When experimentalists observed that currents in two parallel wires can produce a force, they decided to define a new base unit, the ampere ($\rm A$), to quantify currents. In the SI system, 1 $\rm A$ is defined as the constant current between two parallel wires spaced 1 $\rm m$ apart that produces $2 \times 10^{-7 } {\rm N}$ of force per unit length.
Consequently, one can define the electric charge (Coulomb) as current $\times$ time. In the SI system, 1 Coulomb is defined as the quantity of electric charge carried in 1 $\rm s$ by a current of $1$ A.
The electric charge defined this way forces us to write Coulomb's law $\vec{F}=k\frac{q_1 q_2}{r^2}$ as $$\vec{F}=\frac{1}{4\pi\epsilon_0}\frac{q_1 q_2}{r^2},$$ where the constant of proportionality $k$ is fixed to be equal to $\frac{1}{4\pi\epsilon_0}$.
So, in this system, we needed a new base unit to define currents. Also, we can't talk about electric charge without referring to currents. Is there a better way to do this?
Why the Gaussian System is Better
In the Gaussian system, the electric charge is defined directly using Coulomb's law $$\vec{F}=k\frac{q_1 q_2}{r^2},$$ where the constant $k$ is picked to be equal to 1. One statcoulomb is defined as the charge carried by two stationary objects 1 $\rm cm$ apart that produces a force of 1 dyne (i.e. 1 $\rm g\ cm\ s^{-2}$).
The current is then naturally defined as the quantity of charge that flows through a point per unit time. There is no need to define a fourth base unit just to measure current.
Compared to the SI system, the Gaussian system is defined in a simpler and more elegant way. No wonder theoreticians like it more!
PS: Another reason why the Gaussian system is better is that the electric and magnetic fields have the same units. This is nice since electric and magnetic fields transform into each other under Lorentz transformations.