Wire wheeling has been mentionned. There are all sorts of wire wheels. A coarse wire wheel used with a heavy hand can do lots of harm. A fine wire wheel, which has been broken in on scrap can be used very effectively. The piece is not presented to the face of the wheel, against the ends of the wires. It is pressed against the edge, on the side of the wheel, so there is a wiping action. Used with a light touch, rust can be removed without stripping the steel back to bare metal.
I use aluminum oxide or glass beads in my cabinet. Usually al-ox, at 40-50 pounds. This gives a nice base for Park. Cold blue applied to clean fresh from the cabinet pieces bites well, and the effect is of a matte blue.