IMO it is the reliability and durability that improve with price,but yes , when reliability and durability fail I would have to say that the accuracy goes kaput also.
A $100 Tasco may hold zero for a few shots then start to slowly waiver and you may not notice right away , get into a $500 Zeiss, you will have the same zero forever.