Mounted a scope on my hw35 and decided I need to remove the front sight. Looked like an easy job, just loosen the retaining screw and slide it off, except with the screw loose it did not want to budge. I restrained myself from trying to tap it out until I checked here first with more knowledgeable folks. Is a bit of force the next step or not?