If you consider the temperature only

Of course. My hands are in pain in and under -7 °C, even in gloves. This is enough reason to hate it. Even if it also has its own beauties. No other season is causing physical pain. Not even the hot summer (except if the sun burns you, but even that is less painful than the frost).