try to get a video camera and video tape yourself while you shoot.
confidence in your skills and knowing your weaknesses is the key. If you think you are guessing how to shoot, you probably are. It is not a guessing game, it is pretty simple. If it feels weird, ankward, you are doing something wrong.
It could be anything and asking here without watching you shoot will not take you anywhere. It might be your stance, your grip, the way you pull the trigger, your breathing. Many things.
Get a skilled shooter guide you a couple times, not your buddy who shot 3 times more than you twice a year. Someone skilled, someone who competed in IPSC or similar would be a good starting point. Go to a range that has this or similar activity, introduce yourself and ask for help. Joining a similar sport will put you shooting next to skilled shooters and you will enjoy hand gunning a lot more too.
Videos online are ok but not the way to go, you will understand how YOU shoot ONLY if you have someone who knows the fundamentals watching you while you do it.
Dry fire drills help a lot. Look for those.
It is not brain surgery, really. Sight alignment and trigger control. It's all in your brain and getting frustrated with yourself with not take you anywhere. Practice practice practice and one day it will click.
Have fun.