If the last bit of the rifling at the muzzle is bad, nothing will make the Savage shoot well without addressing that. You have looked at the barrel. Perhaps taking the muzzle back a bit, and re crowning would bring back its accuracy. This works sometimes even when there are flaws along the barrel such as an oil ring, or loose area you described.