Are you carrying it like a hunting rifle and slinging it on one shoulder? These things are not designed to be carried like that.
I actually like bullpup. Bullpup works well in prone and kneeling. X95 with grip pod/bipod is the cat ass in section attack type movement. It is much easier to get up from the ground with a X95 than the 1m stick. Easy to run with it without pointing the stick up, and it does not slam down hard on the way to prone like the 1m stick ( physics here, how slegde hammer works ). Saying that, X95 is nowhere near to be the "ideal" bullpup though, I have my complaints about it, but not about it being a bullpup.
The Desert Arms MDR is closer to what I would like in a bullpup ergonomic ( forget about its forward ejecting mech for now ). The issue is that the current LAD in the market pretty much needs 10" to 11" rail space to accommodate all the the BUIS, sling swivel, LAD and switches comfortably. Ideally do not want the switches all over the place so it becomes easy to "miss" the switches at night. X95's 3.5" high bore to top rail height is also becoming something to remember at short range because LAD and the bore diverge both vertically and horizontally.
Whenever I've run a rear-weight biased Bullpup (Tavor, SA80, etc) without a sling, I found that any type of carry position (Sul, Patrol, etc) other than in the shoulder, was more taxing on my wrist and forearms due to that rear wanting to rotate.
During section attacks, I've never had a problem with the 1m stick during fire and movement. Often enough the buttstock gets stuck into under the armpit and steadied anyways.
Quite honestly, I don't have a problem with Bullpups themselves, just with the weight balance of the Tavor and SA80 (as well as how bulky the Tavor Polymer molds feel to me). Funnily enough, even though it has many faults, I find that the weight balance on the T97 to be just about perfectly balanced on the Pistol grip.