If I am thinking correctly, the only difference in the 10103 and the 10118 is the blade with the Hunter 118 having a "V" rear blade and the 103 having the square notch. You don't have to remove the entire rear sight, just replace the blade. It just comes out when you turn the Az screw all the way ccw. I know that Ruger sells the V rear blade for about $3, maybe you can just buy the square blade for the rear and the front blade sight to replace the HI-VIZ if you don't like it. I have the Target sight on the rear of my 103 as it came from the factory and I bought the HI-VIZ for the front. Easier to see in dim light and you can still use the top of the post along with the rear notch...best of both worlds.
PS: Welcome to the forum from West Virginia