You are right, precession can change the local climate, but on a global scale it doesn't change average temperatures because even though it makes our summers warmer, it also makes our winters colder, meaning the average stays constant.

And if it would have any effect on the temperature, we would be able to see that effect in the temperature history of the earth every 26000 years.