I found this answer on this SE about why mirrors don't reflect gamma rays, and the answer says that it is because gamma rays are so, so small that they "see mostly empty space between the atoms of the solid.".
If that is true, so gamma rays can move through atoms without colliding with them, why can gamma rays affect people enough that they are said to be dangerous? If they are so small, that would mean it's very unlikely for a gamma ray to accidentally touch an atom, so it would be a very rare situation, which the body should be able to fix without problems due to it's unlikeliness, right?