It depends. If you see any rip or tear, you can change it. Even if it is broken, the gun will still function fine.
The O rings do not usually break with normal use, they can last many thousend rounds.
They are there to increase accuracy and do not affect the guns reliablity.