In a text book for quantum communication, I learned that one generates optical pulses (wavepackets), each of which contains only one photon. For instance, the state of two wavepackets are described by $|H\rangle_1|V\rangle_2$, where $|H\rangle_1$ ($|V\rangle_2$) means that a single-photon is in horizontal (vertical) polarization and temporal mode 1 (2). I guess, here $|H\rangle_1|V\rangle_2$ is highly temporally-localized states, i.e., it is in a superposition of many single-photon states with different single-frequency plane waves such that the temporal overlap is negligible.
On the other hand, I know that photons are boson, and any bosonic state has to be invariant under the particle exchange. But, the above state $|H\rangle_1|V\rangle_2$ is not symmetric nor anti-symmetric under the exchange because its exchanged state $|V\rangle_1|H\rangle_2$ is clearly different from $|H\rangle_1|V\rangle_2$.
My question is that why we are allowed to consider $|H\rangle_1|V\rangle_2$ despite the fact that any bosonic state is invariant under the particle exchange? Why the state is not a symmetric state, i.e., $(|H\rangle_1|V\rangle_2+|V\rangle_1|H\rangle_2)/\sqrt{2}$?