My cross-peen hammer head won't stay put after a handle swap

I switched out the old handle for a new hickory one last week. No matter how hard I pound the wedge in, it loosens up after a short time at the anvil. What's the deal with getting a solid, lasting fit?