I have heaps of vegetarian friends, but also friends who are similar to you, and buy from ethical farmers. I think that it all makes a difference, and we all have to do what we feel right about :-)
I read an article about the same a while ago - but yes, it's hard on the body too, so I don't know ........I may just keep walking, and yoga, and gardening too ;-)