'Should' you.... that depends on how bad you want to shoot in that weather. 

I guess at the outside stretch, orings might have a little tougher time when the action get to below freezing but if I wanna shoot, I'm not going to let the possibility of having to replace some orings keep me away from my guns. I accepted that risk when I decided to go PCP.