There are a couple of ways to go about curing this problem, both involve removing the flash hider, if there is one, then driving out the cross pins then removing the front sight housing from the barrel. Once that is accomplished, the easiest fix is to tap the 4 holes you now have in the front sight housing 6/32 and put in some set screws. Reassemble everything and centre the rear sight in it's housing. Now zero your windage while shooting by moving the front tight until your groups are centred. This will involve tightening and loosening the screws repeatedly until you have your zero established. Once you have a good zero, mark the front sights place on the barrel. Go home and remove everything and put green hydraulic locktite on both the barrel and front sight housing. replace everything on the barrel and put the front sight where you have marked it then tighten down those screws. They are there to hold the sight in place until the locktite cures.
If your sling swivel is not attached to the front sight housing but on a free float tube of some sort, there is no need to green locktite the housing to the barrel.
The second method is, once you have the front sight housing removed, drill and tap through the bayonet lug and the sling swivel housing to 8/32. Then carefully cut through the bottom of the front sight housing, you can do it with a hacksaw. You have now made a clamp on front sight housing. Decide which side you want the hex bolt head to be on and drill a clearance hole on that side. You will also need to drill out the sling swivel itself to take the 8/32 bolt.
It sounds harder than it is and it gives you a very solid front sight that can be adjusted for windage.
Scott