Imagine saying: Car, drop off Bob Jones, then go home. It could be that simple. So the car says quietly in background, "acknowledged, travel to Robert Jones house, then travel home." It stops at Bob's house, waits for the door to shut plus a few seconds, then takes you home, parking in the garage or driveway.
It could be that simple for a self-driving car to handle instructions.