Yanick, was the bare steel highly polished before you rusted? Surface prep plays a big factor but rust blue is never a high gloss finish.
Steel wool is fine for scratching the black rust off. But it needs to be prepared before use. Just wash it out in isopropynol or laquer thinners to remove all traces of oil.