Background
Suppose we have a Hamiltonian $H(\mathbf{R})$ which depends on some parameters $\mathbf{R}$. For each value of $\mathbf{R}$, the Hamiltonian will have some set of eigenvectors $\{ | \phi_{j} (\mathbf{R}) \rangle \}$.
If we change the parameters $\mathbf{R}$ around some closed loop $C$ in parameter space, we can consider the effect that this has on quantum states. Throughout we assume that the change is made adiabatically, starting and ending at the point $\mathbf{R_{0}}$ in parameter space. We will also ignore all 'dynamical' phases of the form $e^{-i E t / \hbar}$ for simplicity.
Case 1: $H(\mathbf{R})$ is non-degenerate
In this case, if we start off in the eigenstate $| \phi_{i} (\mathbf{R_{0}}) \rangle$, this traversal results in a phase factor between the initial and final states
$$ | \psi_{\mathrm{final}} \rangle = e^{i \gamma_{C}} | \phi_{i} (\mathbf{R_{0}}) \rangle, $$
with the phase $\gamma_{C}$ given by
$$ \gamma_{C} = \int_{C} \mathrm{d} \mathbf{R} \cdot \mathbf{A}(\mathbf{R}), $$
where $\mathbf{A}(\mathbf{R}) = i \langle \phi_{i} (\mathbf{R}) | \nabla_{\mathbf{R}} \phi_{i} (\mathbf{R}) \rangle$ is the Berry vector potential.
$\gamma_{C}$ is known as the Berry phase, and is often called a 'geometric phase' since it depends only on the geometry of the path $C$, not the time taken to traverse it.
Case 2: $H(\mathbf{R})$ is degenerate
If instead the Hamiltonian is degenerate, then this traversal through parameter space will result in a unitary operation on the initial state
$$ | \psi_{\mathrm{final}} \rangle = U_{C} | \phi_{i} (\mathbf{R_{0}}) \rangle, $$
with the unitary operator $U_{C}$ given by
$$ U_{C} = \hat{P} \exp\Big( - \int_{C} \mathrm{d} \mathbf{R} \cdot \mathbf{A}(\mathbf{R}) \Big), $$
where $\hat{P}$ is the path-ordering symbol, and now $\mathbf{A}(\mathbf{R})$ is a matrix with entries
$$ \mathbf{A}_{i j}(\mathbf{R}) = \langle \phi_{i} (\mathbf{R}) | \nabla_{\mathbf{R}} \phi_{j} (\mathbf{R}) \rangle. $$
(Note: this operation is unitary because $\mathbf{A}$ is anti-Hermitian.)
Question
I am trying to understand how the Berry phase relates to the statistics of particle exchange. If I understand correctly, we can model particle exchange in the way I have set out above, by changing some parameters $\mathbf{R}$ of the Hamiltonian. For example, we can imagine $H(\mathbf{R})$ to be some trapping potential which localises the particles at positions $\mathbf{R}$. By changing this trapping potential, we can move the particles around each other.
As far as I'm aware, the phase (or more generally, the unitary operation) that results from this sort of path traversal is only dependent on the topology of the path. Yet from the exposition I've given above, I can see no reason why this phase wouldn't change if the path $C$ were deformed slightly. So my question is
Question: Under what conditions is the Berry phase (or unitary operation) only dependent on the topology of the path through parameter space? Are there any differences in these conditions between Cases 1 and 2?
Thoughts on an answer
From reading the answer to this question, it seems that the Berry phase can be thought of in relation to parallel transport of vectors around loops in the parameter space. Apparently, if the "Berry curvature" is zero except at some isolated points, then the Berry phase is only dependent on whether the loop contains one of these points. In this sense, it is only dependent on path topology.
If this answer is along the right lines, please could someone flesh it out? In particular, why should the Berry curvature be zero?