Yes, even a heavy barrel oscillates as a bullet travels down it. The heavier the barrel walls the less the muzzle moves, but they ALL move.
Accuracy only occurs when ALL the bullets exit the barrel at the same point in the oscillation. If this occurs 100-120fps apart, then that is where the barrel is still or in the middle of it's swing. At 100yrds, this may give 1/4MoA groups, but shoot this same load at 600yrd or beyond, the vertical stringing will blow out the group.
True, most nodes do group together at a certain velocity, and you can 'track' that grouping quite reliably, BUT there are nodes that are quite narrow which are unsuitable for long range due to atmospheric differences influencing velocity that cause vertical.
This is why ladder testing at 300-600yrd is important, you want nodes that are wide and forgiving with slight powder or atmospheric conditions. Some powders are better at this than others, such as H4350 in Creedmoor/6.5x47 size cases, H1000 in 308/AI size cases.
I look for nodes that run .5-1gr wide where it makes no group size difference.
This is normally from powders that are on the slow side for the expansion ratio, the lower presssure helps 'soften' the load some while maintaining high/higher velocity than traditional powders.
The heavier the bullet, the slower the powder tends to be that is optimum for accuracy.
Hope this helps you understand this a little more.
Cheers.