Why is everyone so sad about the end of summer?

Probably mostly because the weather will become colder and darker in many countries. The autumn/fall is not that bad, but the winter is usually very cold (frosty), and the days are much shorter and darker than in the summer and in the autumn/fall.