There are multiple breathing exercises that you can practice with, take for example the breath of fire. Also make sure that you breath in and fill the lower half of your lungs first, causing your belly to protrude. This way of breathing should be done at all times, its the most natural way of breathing.
Also if it is to uncomfortable to do the right breathing during yoga, you can temporarily skip this or lessen the amount of reps.