I hunted many years in Colorado with a 300 WM, shooting either 165 Ballistic Tips or 180 Partitions. Both used RL22 for powder. Had no problems with accuracy at any temperature. Your concerns are baseless. I shot these loads at anywhere from 80+ to 0 degrees.
BTW, I lived in Colorado for 35...