I lived in Allentown for 6 years, and always put on snow tires (including on my all wheel drive vehicles). I've driven the in warm weather, I wouldn't worry one bit about it, just don't expect them to perform like an all season, or anything like a summer. I will continue putting snow tires on even with my P85D.
- - - Updated - - -
I'll add that no matter how good of a winter driver you are, if something unexpected happens, like a deer running in front of your car, or a child running out into the road, winter tires will stop you faster than an all season, period. No amount of experience can make up for that.