Ninezorz, could you possibly explain in greater detail exactly how the paint comes off? You said before you used oil...but I don't see how that would take paint off.
As for the buffing, is sandpaper fine as long as I sand in one direction (back and forth)?
Failure to answer these questions will result in your doom.