Disclaimer: I am mainly a relativist, and I think science has benefitted much more by thinking of gravity as a geometrical entity than as a "force". It is impossible to answer this question without some personal views, so you should know my bias in advance.
That being said, something that no one mentioned yet is: we know how to quantize gravity (with some caveats) and any description of quantum gravity should recover this description at low energies.
We Know How to Quantize Gravity
This is nothing new. The original works, to my knowledge, are due to John Donoghue in the 1990s. One simply quantized general relativity as we would quantize any other theory. This is possible, and has been done. It is highly misleading (and even wrong) when people say "gravity and quantum mechanics are fundamentally incompatible" or anything like this. If you want a discussion about this, I like Percacci's An Introduction to Covariant Quantum Gravity and Asymptotic Safety (this is a book in Asymptotic Safety, which is a specific programme in quantum gravity).
So why does everybody say that we don't know how to quantize gravity? Or why is it an open problem? Because the approach I just mentioned, known as the effective field theory (EFT) approach, only works so far. It is marvelous for simpler calculations such as quantum corrections to the Sun's gravity, or even to black hole gravitational fields. However, it becomes useless at very high energies—namely, at the Planck scale (about $10^{-35} \mathrm{m}$). Now, the Planck scale is precisely when quantum gravity becomes interesting, so the question must go on. We want a theory that describes Physics at the Planck scale.
All Theories Must Recover Gravity as an EFT
So we know gravity as an EFT, but it doesn't describe the Planck scale. Hence, we must figure out that ultimate theory. It has, however, constraints.
For example, any theory of quantum gravity should recover classical general relativity in some limit. That is because we know experimentally that GR works amazingly well, and the theory of quantum gravity should thus make the same predictions (with perhaps negligible corrections) in the situations we tested GR.
However, if gravity is quantum, then it means that gravity as an EFT is correct, because this is just the same theory of classical gravity in a quantum language. Therefore, if gravity is quantum, any quantum theory of gravity should agree (in some limit) with gravity as an EFT.
All Theories of Quantum Gravity Predict the Graviton
Here's the interesting bit: gravity as an EFT predicts a graviton, so since all other theories of quantum gravity must reduce to it, all other theories of quantum gravity must predict a graviton as well. Thus, any theory of quantum gravity can be roughly thought of as being related to some interaction.
So How Can Gravity Be Geometrical?
The fact the theory predicts a graviton doesn't mean the most useful interpretation of the theory is that gravity is a force, or an interaction. For example, one way of thinking about GR is that it is just a field theory like any other field theory. In my experience, however, most interesting developments in GR happened because people treated it as a geometrical theory, not as a field theory. The point of view you take can make it simpler or more difficult to think about the theory, and in GR the geometric point of view surely makes things simpler, at least if you're interested in anything that happened in GR over the last sixty years or so.
Quantum gravity is likely the same. You may prefer to take the point of view that, e.g., string theorists do and view gravity as an interaction, which will lead you some way. It is expected that at least in some limit you need to recover a geometric interpretation, but that geometric interpretation might not be fundamental (just like the force interpretation of Newtonian gravity wasn't fundamental). Other approaches, such as loop quantum gravity, take an inherently geometrical point of view in their descriptions, but this approach need to recover the interaction point of view of gravity as an EFT.
Furthermore, it is important to notice the comparison with electromagnetism and the nuclear forces that Léo Vacher mentioned. These three interactions can be understood geometrically in the language of principal fiber bundles. There is a very clear vision of how their quantized versions recover the geometrical picture in the classical limit, and you can picture their quantization as quantization of geometry, but that ends up giving room to an interaction.