Yes, orange makes you more visible that is the point!

There are unfortunately always moron's that point their guns where they shouldn't but I don't think wearing some bright color out there changes that one way or another. The idiot who would point his rifle at some blaze orange that he spots will also point his rifle at the camo mound he see's moving around out there.....

The only difference is he already knows that the former is another hunter but hasn't yet figured out that the latter is as well......
In my opinion I think wearing orange means that less of the time a scope is being pointed at me.
The guys I hunt with don't point their rifles at other hunters and having some orange on allows us to keep a better eye on each other out there and is in my opinion safer that not having it on. To each their own.