It happens to me when I am not very focused or motivated in what I am doing that my thoughts fly to another place and like you I came to the conclusion that it is best to pay full attention to what we do or we will spend more time than necessary doing something, it has happened to me, so I should put more emphasis or concentration on focusing on the present moment, on what I do.