I was using 180 grain Norma bullet in my 30-06 Husqvarna. A certain weight of IMR4350 gave 2642, while the same weight of Norma 204, gave 2732 fps.
Amazingly, so I thought, the same weight of Herters#100 powder gave teh 180 grain bullet 2785, with no sign of excess pressure in any of these loads.
I upped the charge of Norma 204 a bit and got a three shot average of 2810, with no excess pressure noted and a es of 11.
I never got quite as much velocity out of 4350, but you probably could.
REgarding accuracy, it has been my experience that, especially with these slow powders, you load them right up for best accuracy. Those powders are designed to burn a certain pressure and that is where they are most efficient.
I have a beautiful accurate load with 165 grain Hornady and Norma 204 powder, going 2912 over the Oehler.
So, the short answer to your question, "Yes, you should be able to get an accurate load at 2800 fps with a 180 grain bullet."