How should we interpret Boltzmann's distribution when the set $\{ E_1, E_2, \cdots, E_k \}$ (in increasing order) of energy levels is a finite set? In that case, the expected energy cannot exceed $E_k$, and in any case the infinite temperature distribution would be uniform over the $k$ microstates, and have expected energy $E = \dfrac{1}{k} \sum_i{E_i}$, wouldn't it?
My understanding is as follows:
Boltzmann's distribution arises from maximizing $-\sum_i{p_i \log p_i}$ subject to $\sum_i{p_i} = 1$ and $\sum_i{p_i E_i} = E$. From this, we get:
$p_i = \dfrac{1}{Z} e^{- \beta E_i}$
$Z = \sum_i{e^{-\beta E_i}}$
where $\beta$ is the Lagrange multipler of the constraint $\beta (\sum_i{p_i E_i} - E)$
So, the case of $\beta = 0$ should arise if we set $E = \infty$, but that is unattainable.
EDIT: Digging a little further, I realized that if we use:
$E(\beta) = - \dfrac{ \partial \log Z(\beta) }{ \partial \beta } = \dfrac{1}{Z}\sum_i{E_i e^{-\beta E_i}}$
then:
$E(0) = \dfrac{1}{k} \sum_i{E_i}$
So, this is a counterintuitive result, that at infinite temperature, this system will have finite average energy. I suppose this means that no physical system has only a finite number of quantum states? That is, there is always a higher energy state for it if you want to add energy?
