Couple of good suggestions here already:
Try with open sights (as suggested), and check barrel retaining clip (as suggested). Tied together (kinda). Not only will you eliminate possible scope error, but the 64 barrel to receiver mating can cause issues with consistency. Some barrels fit incredibly snug, but some are loose(not sloppy). The clip itself can become kind of deformed through over-torquing. With scope on receiver, and barrel not snug n' true hitting anything becomes tricky. Already suggested, but I'll echo...a touch of bedding can help with this issue. I've not had m'paws on a heavy barrelled flavour, but most 64 barrels can be deflected with your thumbs, when folding tip of fore-stock with fingers.
I had a scope n' see-thru rings for ages on one of my fav 64s. A cleaning usually meant a re-zeroing no matter how cautious/precise I was.
Otherwise typical troubleshooting steps. Change ammo, try multiple shooters(no offence whatsoever intended to original trigger squeezer), etc...