I’d expect your choice of ammo is an issue, as well as flinching at your trigger pull in anticipation of the recoil.
I have the .457 Texan and the most common reason I’ve seen for inaccuracies when I let others try it out are the big flinch and jerking the trigger.
You can dial up your Airforce to launch big heavy lead, but that doesn’t mean it’s going to do so accurately. You have to buy several different weights to try and see what works best. Once you find a slug that shows great potential with nice groups, then you can play with the tuning wheel a bit and dial it in better.
I highly advise checking out Nielsen Specialty Ammunition and reading reviews of other people that are shooting the same caliber/gun and start with the highest rated choices there.