Right. If you are using RPC to a node now, you are trusting the node to be providing authentic data.

A plugin to retrieve just the data you need inherits the same same trust requirement but with a lot less overhead. This is even true if using your own node on your own hardware, since retrieving all the data over RPC (only to discard 90%+ of it) is itself pretty expensive.