Usually face recoil issues are caused by pitch problems. Stock length can also be an issue. I assume that you are shooting with your gun mounted on your shoulder and head on the stock as opposed to a gun down position when calling for the target.
Generally speaking, when mounted your thumb should be a maximum of 2" from your nose and no less than 3/4". One of the top trap shooters says that the gun isn't too short unless you are poking yourself in the nose. There are always exceptions to every rule, but generally these are the numbers that stock fitters go by.
Assuming that your gun is within the above parameters, look at pitch. The usual problem is that the recoil pad doesn't come into full contact with your shoulder. Many of us are heavy chested and the stock does not have enough pitch. A temporary way of checking this is to add a couple of flat washers between the recoil pad and stock under the top screw of the recoil pad. You may need just one washer or three, but experiment. This is most likely the problem area.