I cannot find papers that explore the motion of an alpha particle about its own axis.
That's because there isn't much to say about it. Alpha particles are quantum-mechanical objects and, as such, their rotational properties are governed by quantum mechanics. In QM, angular momentum is quantized, i.e. it can only take values from a discrete set of possibilities, which happens to be $\{0,\frac12,1,\frac32,2,\frac52,3,\ldots\}$, i.e. all integers and half-integers.
As it happens, alpha particles have angular momentum $J=0$. We know this from a huge base of evidence, both experimental (e.g. the lack of hyperfine structure in helium spectroscopy) and theoretical (where we have a solid understanding of nuclear structure). The implications of alpha particles having $J=0$ is that there is no sense in which they can be said to "rotate" internally. They hold no angular momentum beyond the 'orbital' angular momentum associated with the motion of their center of mass.
If you don't like this, tough. If you don't understand it, then you do need to start with an introductory quantum-physics textbook. The reason you can't find papers discussing the rotation of alpha particles it is that it's an easily solvable problem, at the level of an end-of-chapter exercise in an introductory nuclear physics textbook, or an obvious off-the-cuff remark (so see e.g. the start of ยง8.5 here).
But, just to emphasize, if you try to probe it experimentally, you won't find anything.
- the billiard ball analogy - if an alpha particle has a spin and it hits a nucleus, then it should preferentially scatter in one direction.
Alpha particles don't have spin, and they don't scatter preferentially in any direction that would be spin-dependent.
- Lorentz force change - if an alpha particle is not spinning and it travels through a magnetic field, it will deviate a specific amount for a specific magnetic field strength. If an alpha particle is spinning, its magnetic field (as a result of Faraday's law that a spinning charge makes a magnetic field) will interact with the imposed magnetic field and cause a deviation from the expected path.
For particles with spin, the correct understanding is not the Lorentz force, but rather the force on a magnetic dipole in an inhomogeneous magnetic field, which is given by $\mathbf F = \nabla (\boldsymbol \mu\cdot\mathbf B)$, i.e. the gradient of the projection of the magnetic field onto the magnetic dipole moment $\boldsymbol \mu$. For quantum particles, the magnetic dipole moment is proportional to the spin, so this effect can be used to separate particles according to their angular momentum; this configuration is known as a Stern-Gerlach device.
However, since alpha particles have no spin, they are not deflected by Stern-Gerlach devices.
That said, there's an additional misconception in your post, specifically when you say
As they exit the cyclotron, they go straight so all that angular momentum goes from being a revolution in space to a rotation.
When they're circling around the cyclotron, the particles have orbital angular momentum $\mathbf L = \mathbf r\times\mathbf p$, which can be understood within classical mechanics, and which comes from the fact that the line of action of their velocity does not go through the origin (at the center of the cyclotron). If you release them so that they go straight out on a tangent to the circle, that property is still true, so they still have the same amount of (orbital) angular momentum.