Exactly that's right.

That's why staked power is called as "influence" .

Your POB staked is say 100 and total POB staked is 1000 so your influence is 10% .

Now if you staked 50 more and everyone else staked 10000 more then obviously your influence decreased right ? So less rewards for you.