but to HAProxy they would return a heathy status and would continue to serve traffic.

No, that's not necessarily true, and it's not true the way we use it. Haproxy allows you to define your health check.