Apollo missions took about three days to reach the moon. But the quickest trip to the moon was the New Horizons probe, which zipped past the moon in just 8 hours 35 minutes on its way to Pluto. However, the spacecraft didn't even slow down or approach lunar orbit.
Source : http://www.space.com/18145-how-far-is-the-moon.html