I can't say if your concentricity if being harmed by your ammo making normal feeding contact in your rifle but I doubt it.
I can tell you that, technically, the point you are addressing is a part of the action that's called the "feed ramp", not the receiver.