Geoff,
You point is well taken. I try to only wear the glove when I want the bird to come to me otherwise its off. If I go in the mews to get her, I wear the glove, if I go in to change the water or do other chores I don't. She looks for the glove when I enter, if she doesn't see it she carries on with whatever she was doing and responds similarly in the field. As I get more experience that might change but for now...
Being a surgeon, I am subconsciously aware of my hands, especially with gloves on, because of sterile technique. I would never touch my nose with my sterile hawking glove