I'm with Chuck on this one.
To me the word "custom" means that the rifle is made exactly how I want it, according to my specifications. I can tell you that if I'm ordering a custom rifle, it's not going to have wood on it. It'll have the stock that I want, configured the way I want it. So when I call up McMillan or Brown Precision and order a specific model stock, finished to the degree that suits me, at a length that fits me, with the recoil pad that I like, with the paint/finish that seems best to me, using the material that I prefer (kevlar/carbon fiber, fiberglass, etc), that weighs as much or as little as I want it to, and then my smith uses a barrel made by the company of my choice to the specs of my choice, with the action of my choosing, etc, then it's a rifle made "custom" for me.
The materials used in the rifle have nothing to do with the word "custom". Custom means I choose what materials go into it, and they are not dictated by someone else. If "custom" truly meant that the rifle had to be hand-crafted specifically for the customer, then the barrel, action, trigger, and stock would all have to be made by hand in the gunsmith's shop. Ironic that we are considering dictating that a "custom" rifle be made with wood, which may not be what customer wants if he could choose what components go into the rifle, thereby contradicting the very meaning of the word "custom".