Try concentrating on smoothly pushing the trigger straight back and not just pulling the trigger smoothly.
The natural biomechanics of your finger wants to push things to the left and the fact that your finger is under the barrel means it wants to pull it down.
The natural biomechanics of your finger wants to push things to the left and the fact that your finger is under the barrel means it wants to pull it down.