Back in the '50's when the .30-06 was "the" high power match rifle, folks loaded Sierra's 180-gr. spitzer boattail bullet over 48 to 49 grains of IMR4064 for best accuracy. That should be a good place to start for any 180 in an '06.
180's in a .308, 43 grains of IMR4064 was equally as good in competition. It still is.
While 4350 will give a bit more muzzle velocity at the same pressure, 4064 has proved more accurate with 180's.
Ball powders were never all that great for accuracy.
Open Hogdon's website for reloading data. I should have all of the powders you mention and gives you a good idea of starting and max. loads. I think the accuracy will depend on each gun, but it's a good starting point. Hornady prints their reload manual once a year as a magazine, and it's great.
Regarding twists for 180's in .30-06 and .308 barrels, in those cartridges heyday for competition, best accuracy came with 1:11 twists in 22 inch barrels or 1:12 in 24 and 26 inch ones. The US Army used extra hot loads with 180's in their 22 inch M14NM barrels with 1:12 twists.
If ones barrel has a faster twist, I'd use reduced loads so the bullets don't spin too fast upon exit. Too high of an rpm on bullets causes accuracy to get worse; bullets tend to jump off the muzzle axis due to centrifugal forces. All bullets are not perfectly balanced. Which is why benchresters use the slowest twist possible to stabilize bullets all the way to the target.