You may have developed a flinch, you need to train yourself to not flinch. Remain perfectly calm and still, and it should be a surprise to you when it goes off. I mean anticipating the recoil and reacting to recoil before it actually happens is the most common cause for flinching, so it is important for you to train yourself to not expect the recoil and let it be a surprise.
It may be that your eyes were better when you were a kid, and your eye sight could be worse now. It is also very likely that as an adult with the many things that you are now responsible for, you might have more stress or more worrying now. Stress and worrying would make it more difficult for you to get into the right relaxed mindset needed for good aim. Do not rush your shots, you are not in a competition and you are not in a time limit. Take as long to aim as you need, and do not fire until you are ready.
Do not hold your breath. Remember to breathe. Your muscles will shake worse from buildup of CO2 if you are not breathing.