According to what reticle your scope has. If it is a standard duplex type or straight cross hair you can do it the Shade Tree Mechanic way. I have seen old pump or semi rifles set up this way to keep the case from falling back in the action. Turn the scope 90 degrees counter clock wise. This gets the windage turrent out of the ejection path of the case. But now the elevation turrent is the windage adjustment, and the windage turrent is the elevation adjustment. Be sure to take a good bottle of your favorite spirits with you on site in day to settle your nerves. OR
Replace the bolt is about the real solution.
Is the new extractor right at the top edge of the right bolt lug straight across from the ejector pen?