Does the bird come instantly to the lure? If so then you may have a better idea of whether it is a weight issue, or a glove issue or something else that you pick up on by doing something different.

If the bird does come to the lure, then maybe call to the lure for a tidbit then jump the to glove for another tidbit and back to hunting. A lot of accipiter people do this. With my coop I did this because I could fly her at a higher weight than I could if I insisted she must come to the glove. Just throwing out a possible work around if it worked for ya and you wanted to keep hunting.