The number one thing that keeps anglers from having fun and being effective in cold weather is... cold hands! Its very tough to have fun when you can't move your fingers, tie knots, and are just plain miserable. Get good gloves.
Anglers should always bring two pairs of gloves. It just makes sense. You will often need to do things that get your hands wet! Like landing a large fish. Always bring two pairs of gloves. I personally like to have one set of wool half finger gloves all the time. I also like fold-over mitts when it gets really nasty, but when I am rowing, launching the boat, winching the boat up etc. I really like something with full coverage and tough materials. So maybe you need three pairs haha.
Anglers also like gloves to protect their hands from the sun as well. Harsh UV rays on tropical fly fishing trips can ruin your adventure. Sun gloves are made strictly for UV protection, and Guide Gloves have a leather palm for sun protection and for rowing.