Because Newton's Gravity is based on mass, and supposedly holds the Galaxy and Universe together.

But there is not enough mass, like we are off by orders of orders of magnitude.

Newton's Gravity is what science thinks.
Most people think gravity means falling down / being held down.

And sooooooooo,