Yeah I would definately say put off rebarreling it for now. Spend the money on some match ammo. I use the Federal Gold Medal Match. I use the 175gr which is great, but have also used the 168gr which is great as well. The stuff is expensive, but if you're looking for accuracy then it's worth it. Start reloading when you can to cut costs and improve accuracy. Also, if you're looking for something to put your money into, I would suggest putting it into some quality glass, rings and a base. And... you might want to put some money into either getting a new stock for it, or reinforcing and bedding the one that you have. I think if you do that to the stock you'll see your groups shrink right away.
That's just my 2 cents.