Don't worry about what other people tell you. If you're successfully hunting with the setup you have why worry? If it ain't broke don't fix it.
If you happen to borrow someone else's rifle and they have a different scope that you find to be better, then think about changing. That's what happened to me last fall. I had a problem with my rifle and had to borrow my friend's that was topped with a Leupold VX-L. I've never really believed that those $1200 scopes were really much better than the $600 ones, but in this case I was so impressed with the low light abilities that I had to get one. Now I'm saving up for my second one, although it's more for the ability to mount the scope extra low on the rifle in addition to the low light ability.
FWIW I think Burris Fullfield and Bushnell 4200 optics are equal to Leupold VXIII and VX-L, but there's more to a scope than just clarity.