I've recently delegated to helios.voter. I wasn't aware of the being a holder part.
Do you happen to know where can I find some info on that?

Also, I think it's perfectly fair to be doing that.
Maybe up the 0% to 2 months inactivity and maybe 2-4% for accounts not active between 1-2 months.