There is a simple way in which I understand this concept of raising and lowering operators. I'll try to explain it in two stages.
First, given the assumed relation
$$ [\hat{a},\hat{a}^{\dagger}] = \mathbf{1} , $$
where $\hat{a}$ and $\hat{a}^{\dagger}$ are the ladder operators, and $\mathbf{1}$ is the identity, we can construct a number operator
$$ \hat{n} = \hat{a}^{\dagger}\hat{a} . $$
It then follows that
$$ [\hat{n},\hat{a}] = -\hat{a}
~~~ \text{and} ~~~
[\hat{n},\hat{a}^{\dagger}] = \hat{a}^{\dagger} . $$
So, it produces mechanism for the raising and lowering action. When we now have another operator constructed from the same product of ladder operators as found in the number operators, we will get a similar action. For example, Hamiltonian
$$ \hat{H} = \frac{1}{2}\hbar\omega(\hat{a}^{\dagger}\hat{a}
+\hat{a}^{\dagger}\hat{a}) , $$
leads to
$$ [\hat{H},\hat{a}] = -\hbar\omega\hat{a}
~~~ \text{and} ~~~
[\hat{H},\hat{a}^{\dagger}] = \hbar\omega\hat{a}^{\dagger} . $$
which we can interpret as the increase or decrease in the number of quanta in the eigenstates of the Hamiltonian.
With this basic structure in place, one can ask how to apply this structure to specific scenarios which may have different numbers of dimensions. That leads to the second phase of the discussion, which is to give a kind of back story.
The question is, how would one construct these ladder operators in the first place? We start with any Hermitian operator $\hat{q}$ that can be express in terms of its eigenstates and eigenvectors as (the summations can be replaced by integrals for the continuous case)
$$ \hat{q} = \sum_q |q\rangle q \langle q| . $$
The eigenstates $|q\rangle$ is a complete orthogonal basis for the space we consider here.
Next, construct another basis which is mutually unbiased with respect to this basis. It is easily done with
$$ |p\rangle=\sum_q |q\rangle \exp(ipq) . $$
Then we can define another Hermitian operator
$$ \hat{p} = \sum_p |p\rangle p \langle p| . $$
Without too much effort, one can now show that
$$ [\hat{q},\hat{p}] = i\mathbf{1} . $$
The final step is the define the ladder operators in terms of these Hermitian operators by
$$ \hat{a} = \frac{1}{\sqrt{2}} (\hat{q}+i\hat{p})
~~~ \text{and} ~~~
\hat{a}^{\dagger} = \frac{1}{\sqrt{2}} (\hat{q}-i\hat{p}) . $$
Their commutation relation will then reproduce that which I initially assumed above.
The above analysis readily works for the infinite dimensional case. In the finite dimensional case, the operators are often given in terms of matrices, which are already known. These matrices will have mutually unbiased eigenvectors if they do not commute. As an instructive exercise, you can consider the two-dimensional case in terms of the Pauli matrices, noting that their eigenvectors are mutually unbiased.