How about... Put all IPFS images to be loaded from ipfs.io first, then if error or, let's say, 2 seconds timeout happens, you change them to your own IPFS server?

Just a random thought, although I did this years ago in an old experiment called QDP.