If it was me I'd either have a good smith work that trigger over or have him install a good aftermarket unit. It's just my personal opinion but a 3.5# trigger would drive me crazy on a long range gun. Most of mine run about 1.5#. The more muscle you have to use to break the shot the more of a chance you're going to do something slightly different as in side pressure on the trigger, not pulling straight back, not making contact with the same part of your finger each time etc. etc. etc.
The components of the build seem to indicate that it should be a shooter so given what you are getting for accuracy, if it was me, I'd start over and see if I couldn't find a different, more accurate load.
Do you have other guns that you can shoot more accurately than this one? Have you ever had anyone else shoot the same gun to see what the results are?
I find that the field conditions I shoot in seldom tend to mimic what I may use at the bench/range when testing. Thus I try to make sure my long range gun will shoot at the bench under the same conditions as when I'm in the field. I know some people have guns that won't shoot off hard surfaces but I'm lucky in that my long range rigs aren't that finicky. I also carry a frisbee with me when shooting and have found that the slick surface and broad area gives me good results with the bipod. I know this sounds goofy but it only costs a couple of bucks to find out if it works for you. I can put that frisbee down in sand, dirt, grass, lava rock, plain rocks, mud etc. and the gun/bipod always sees the same nice slick surface. No guarantees but it's something to try.
