I would consider flight simply moving the hand, the fact that you're on the hand isn't an action of the spell.
Not that i'm an authority really, i do like playing around with words quite a lot however and i think this interpretation overlaps
A spectral, floating hand appears. The hand lasts for the duration or until you dismiss it as an action. It vanishes if it's ever more than 30 feet away from you or if you cast this spell again.
You can use your action to control the hand. You can use it to manipulate an object, open an unlocked door or container, stow or retrieve an item from an open container, or pour the contents out of a vial. You can move the hand up to 30 feet at a time. The hand can't attack, activate magic items, or carry more than 10 pounds
Specifically because the hand is not manipulating the creature, it is moving and the creature is holding on