I like shooting off hand and shooting service rifle matches, but I also like shooting tiny little groups and picking of 1" size target at 100 yds. For me the consistent match grade accuracy is a big factor, I don't want to lose.
Keep the Noveske. You seem to be more of a precision guy, and as others have said, the Noveske is more that kind of gun.
And like you've said, the Noveske isn't something you'll see every day, but the SR-15 is getting cheaper and more common.