I have limited experience with fishing in the freezing cold, but when I have, I have used the Orvis gloves, but recently upgraded to the Simms ones, they are great, but I learnt a few things.
Put an elastic on each one, attach the elastic to your elbow, then when you need to get your hands all wet, pull the glove off with your teeth, the glove springs up to your elbow, do what you have too. I have a golf towel in my vest; I dry my hands and pull my nice warm, DRY gloves back on. Try it, it works a charm…
Wear the quick dry, sun gloves under your warm gloves, this wicks the excess water straight out…
Carry 2 or 3 pairs, try to get gloves that can be worn on either hand, thus you can change them quickly, just stick your hand in your pack and pull any one of them out.