It's probably inevitable. However, it's not really possible to make any completely definitive statements about Hawking radiation because it's a quantum process involving general relativity, and we don't yet have a consistent theory of quantum gravity. But let's assume that Hawking's derivation is basically correct...
The Hawking radiation temperature of a black hole is inversely proportional to its mass. Even stellar mass BHs are very cold, so they radiate very slowly, and the supermassive BHs at the hearts of most galaxies are even colder.
According to Viktor Toth's Hawking radiation calculator, a 5 solar mass BH, which has a Schwarzschild radius of ~14.770 km, has a Hawking temperature of 1.23374e-8 K and an expected lifetime of 1.44968e69 years.
However, the cosmic microwave background (CMB) radiation is currently 2.73 K, which is over 200 million times hotter than the 5 solar mass BH. So in the present era, black holes are absorbing more energy than they radiate. The CMB cools as the universe expands, but it will take around 1e29 years before the CMB is cooler than even the smallest BHs that can be formed via core-collapse supernovae. And of course those BHs will continue to grow and get colder in the intervening years.
It's currently around 13.7 billion years since the Big Bang, but that's less than an eyeblink compared to 1e29 years. And that's less than an eyeblink compared to 1.4e69 years. So even though black holes won't start losing mass until the universe is more than a billion billion times its current age, the evaporation time is so long that that delay is effectively negligible. ;)
By the time the BH evaporation era begins there won't be much else left in the universe, except maybe a few neutron stars and black dwarfs that haven't yet fallen into a black hole. There definitely won't be any remaining accretion disks. There may still be some stray matter floating around, but if so, it will be extremely diffuse.
Wikipedia has an interesting timeline of the far future, but it includes some speculative things, like proton decay, and it's not completely self-consistent.