I noticed that the daemon running locally somehow resolves this, but bugs our on regular basis, so you need to restart it often. IPFS needs a lot of tuning to become stable.