.
A half minute change of zero at 50 yards? Unless you are an Olympic Target Shooter, that is hardly something to get your shorts up tight about.
Since you seem to have vertical stringing, I would look at the bedding, especially in the fore end of the stock. Make sure the action screws are tight.
Temperature, humidity, and even the position of the shooter's hand on the forestock can easily cause this. The OP is in southern Ontario, which is close to the Great Lakes and does have a high humidity factor in the summer, along with high summer temperatures.
A 3 o'clock or a 9 o'clock will not affect VERTICAL stringing too much but will affect horizontal bullet drift. A 12 o'clock wind tends to push bullets UP and a 6 o'clock wind pushes them DOWN. However, this is more for longer ranges and unless it is a terrific wind out there, the 50 yard affect would not be a lot.
Another factor most people do not take into account is LIGHT. The angle and direction of the Sun can affect shooting. Mirage, or heat waves off a hot barrel will give a false position of a target.
.
.
.