It will be very challenging to get a complete rifle, scope and reloading set up for your budget of $2,000. I would look at all used stuff, preferably a package deal on a rifle/scope.
I suggest buying the components that you want from the start. Don't buy a $400 scope just to get going. That money will be lost when you replace it with a $1000 scope.
Look at Redding for reloading equipment. Not the cheaperst but will last a lifetime and not overly expensive.
Take it from someone with cabinets full of stuff that's been replaced/upgraded. It's cheaper to buy what you really want from the start. I'm a slow learner