does skipping to results affect anything or should I let it play out

No, it does not affect anything, because the result of the battle is already known at the start of the battle, and every battle is recorded on the blockchain, so you can watch their replay anytime.

I think I have won 1 out of about 25 games?

Probably you have only a basic card set. Not easy to win with that. I played 6556 battles so far, and I have won 3350 battles from that, so approximately the half of it. I play Splinterlands since 2018.12.30.