Rugers with fixed sights have a tall front sight so you can match it to the load you shoot. Find a load you want to stay with and then file the front blade to adjust POI.
Some of the older Rugers in .45Colt had issues with fliers. I believe it had to do with poorly machined forcing cones, an easy fix.
AFAIK the .44 and .41mag should shoot straight, every one I own does. 4moa, supported from a bag at 50yds is normal from my scoped Rugers. YMMV