You're taking all the fun awaybuy a pivot pin installation tool. Or make one, it's just a piece of brass or aluminum the same diameter as the pivot pin with a hole in it the size of the detent. You can do it without the tool but it makes things a lot easier and you say the F word a lot less.
Welcome to Model 1 Sales' Online Order Center
they have one there but you can probably pick them up anywhere.