FX FX Impact M4 Charging handle hard to close

From the title, the charging handle on my M4 is/was hard to close. I was have a pin probe for shooting slugs and I had it adjusted to what I though was the 'correct' depth for my gun. Today I ended up pulling my barrel off and after reassembly the charging handle the last little bit before it would close became very stiff. I ended up backing the set screw out and adjusting the pin a little further out which did make the handle easy to close again.

Not very familiar with how all of this stuff works together so any feedback would be great!

Thank you in advance!