I'm not a guy from physics. Let me explain in a simpler case.
Consider $V$ a vector space which endows with a (continuous) $G$-symmetry, that is there is a $G$-action on $V$:
$$G\times V\longrightarrow V$$
We know the identity element $1\in G$ acts as the identity transformation on $V$. Now, what about the actions of elements which are near to $1$?
Those elements are near to $1$ can be described by the tangent space of $G$ at $1$, i.e., the Lie algebra $\mathfrak{g}$. Such an element can be write as $\exp(\epsilon X)$, where $X\in\mathfrak{g}$ and $\epsilon$ a small real number.
To measure the difference between the identity action and the actions of the elements which are near to 1, we can use
$$\lim_{\epsilon\to 0}\frac{\exp (\epsilon X)\cdot v-v}{\epsilon}$$
That quantity is supposed to be a vector in $V$, denoted by $\underline{X}(v)$.It means if we perturb the identity element along direction $X$ by a small $\epsilon$, then the perturbed action takes $v$ to $v+\epsilon \underline{X}(v)$.
The above action:
$$\mathfrak{g}\times V\longrightarrow V, (X,v)\mapsto \underline{X}(v)$$
is referred as the infinitesimal action, or the infinitesimal symmetry.
If we replace $V$ by a bended manifold $M$, the corresponding infinitesimal action becomes to
$$\mathfrak{g}\times M\longrightarrow TM$$
as $\underline{X}(x)=\left.\frac{d}{d\epsilon}\right|_{\epsilon=0}\exp(\epsilon X)\cdot x$ is now a vector field, called the fundamental vector field.