Let me illustrate my question with an example. Suppose I want to consider a system of $N$ identical bosons. The Hamiltonian of the system is typically of the form: $$H_{N} = \sum_{j=1}^{N}(-\Delta_{x_{j}}) + \sum_{1 \le i < j \le N}V(x_{i}-x_{j})$$ for some interaction potential $V$. Such systems are usually said to be in the zero temperature setting (e.g. I have seen such terminology in many books on many-body quantum mechanics) as opposed to systems with positive temperature where the equilibrium state is given some density matrix.
If the system is at $T=0$, all particles should be at the ground state and no excited state is possible. However, this is clearly not true for an arbitrary quantum system, given that if we solve Schrödinger's equation $H_{N}\psi_{N} = E\psi_{N}$ we would have a lot of possible excited states given a full range of different energies. Thus, I assume that what is meant by zero temperature systems is actually low temperature, not zero.
But if the temperature is low, this means that the average energy should be also low, right? But there is no restriction on our systems to have a low average $\langle H_{N}\rangle$. Why is temperature not relevant then? And when is it, so we must consider density matrices instead of pure states?