For what it is worth: Most of my hunting since the 1960's has been with a 6.5 Remington magnum in a custom rifle
which had all the advantages the factory weapons did not. My competition shooting at 600-1,000 has been with the 6.5 x 284. When I compare the problems the magnum brass caused at higher pressures compared to the 6.5 x 284 I wished I would have had the 6.5 x 284 chambering in both all this time.
Most shooters who may choose the 6.5-'06 have not owned one. It is not a bad cartridge. With modern powders you can virtually duplicate its performance with the .260. One hundred feet per second difference can't be seen on a three hundred yard target and no animal you wish to hunt could ever tell the difference. An elks' lungs and heart are large, push a modern expanding bullet through either organ and that elk will die.
Accuracy, can you get enough of it? If you know the distance to the target and know your trajectory shoot that which recoils less and does not affect the five different nerves that run through your axilla ( armpit) region. Human beings respond to being punched in the shoulder, so moreso, some less. It takes time to really get to know a rifle. Learn about the rifle with the cartridge/barrel that lasts longer. In the long run, if 'smithed correctly you will grow to appreciate the .260, long after the concerns over some small amount of velocity are long forgotten.
Good Luck in your search.