A properly cut and crowned barrel will not detrimentally affect accuracy, it may also not improve it. If you are looking to have a better shooting barrel, I would recommend that you have the barrel setback, match chamber cut, cut the barrel and crown. You will likely see improvements if the barrel doesn't shoot that well currently. However if you are looking for a lighter rifle to carry around, then just cut and crown it as it won't shoot any worse then it currently does however it could end up shooting better (assuming that the smith does the work correctly)
Obtunded: Normally I agree with all of your posts, I don't think I agree with your last one. I can't see latent stress being an issue at the Cut/Crown portion of the barrel making process - Most rifle manufacturers and gunsmiths do that portion near the end and frequently the result are good - when it is bad it would be hard to say that it is traced to the barrel cutting/crowning process. I know that stress is an issue for changing the contour of the barrel/fluting but I just can't see it being an issue for the crowning/barrel cutting unless the smith screwed the crowning portion up... Just my 2 cents.