I used small rifle Magnum primers in my 357 Magnum rifle.
There does seem to be a significant difference in ignition speed. I started off with the lowest suggested load and worked up to within a tenth grain of maximum
I have a lot of HS6 on hand and chose that powder for that reason alone, seeing as it has close to perfect bulk ratio for the case.
My velocities are almost identical to suggested manual velocities for a 22 in barrel, just over 1450 fps and very consistent.
I've shot a couple of hundred such rounds this spring and no failures to fire or hang fires.
I tried magnum pistol primers and the results were a few fps slower, not enough to make a difference IMHO.
I also tried standard sp primers but there was a fair bit of velocity spread out of my rifle. Likely nothing to worry about in handgun length barrels.
I only tried the srm primers out of curiosity. IMHO, they will work fine in your rifle, if you can't find smp primers
HS6 is a great powder but can be difficult to ignite consistently. When you can find a good recipe, it's one of the most consistent powders going and has quite a wide range of uses.