I have a .30-06 with ABs, 168gr that do about 2700fps. Never had an issue with a deer, elk or a moose for that matter, I do not even recall putting a 2nd round into a deer.
I have experienced what you have done, I used to shoot in the front shoulder so the animal would go down and never move...